Showing posts with label #CENSUSfail. Show all posts
Showing posts with label #CENSUSfail. Show all posts

Sunday 11 September 2016

#CensusFail 2016 continues to erode public trust



Finally it appears that the Australian Bureau of Statistics (ABS) is admitting to being in a crisis situation with regards to the 2016 national census.

A census for which it had anticipated requiring around 39,000 Australians to help us run the Census. [ABS, Forward Work Program 2015-16 to 2018-19, p19]

One month after Census Night on 9 August and the ABS is now advertising for additional Census Field Officers - presumably to chase up all those households who are reluctant to participate in a national survey which retains names and addresses to assist with future data matching for unspecified purposes or who are now worried about the integrity of data security supposedly safeguarding their personal information.

Successive funding cuts under the last two federal governments may go some way to explaining the workplace situation in Belconnen, as does the leadership role of Australian Statistician David Kalisch.

However it is interesting to note that serious problems in the ABS first made an appearance in the wake of the Abbott Government coming to power and intensified after Prime Minister Turnbull and the Dept. of Prime Minister and Cabinet became involved.

Given the nature of politicians and bureaucrats (and their inability to fully accept responsibility for the consequences of their own actions) I expect that many ordinary Australians will find ABS letters threatening legal action amongst their Christmas mail this year.

All in the possibly vain hope that more than 95.1 per cent of an est. 9,268,673 Australian households [ABS, (March 2015) Household and Family Projections, Australia, 2011 to 2036will have been successfully coerced into completing the census form, thereby keeping the statistical margin of error low enough to render analysis reliable across sub-populations/populations and save the 2016 census from being ignominiously binned.

Right now I'm betting that the ABS is somewhere between 464,000 and 500,000 completed census forms short of meeting that target.

BACKGROUND

Excerpt from Australian Bureau of Statistics letter to James Smith, 6 September 2016:

The ABS does not profile people who are fined, and as such a single document explaining this does not exist. Rather, detailed case files are kept for each person.

Crikey.com.au, 8 September 2016:

A "crisis" in the rate of returns of censuses has forced the Australian Bureau of Statistics to increase its level of harassment of Australians -- even of people who've already completed and lodged their forms.

Senior Australian Bureau of Statistics officials have warned staff of a “crisis” over the rate of return of censuses and demanded collectors increase the level of harassment of Australians, including those who can furnish evidence they have already lodged it.

Sources within the bureau have told of an extraordinary change in policy yesterday by ABS executives. On Monday, census field officers were told in writing that they did not need to return to a dwelling that had advised that the census has been completed. This included anyone who had produced a receipt number for their online census submission or who said they had done so, or who said they had posted the census form. However, citing a “crisis” in the rate of returns, ABS management yesterday told staff that they were now required to make a further visit. Householders who asked why were to be told that “it is still being investigated and [they are] still on their list requiring a visit”.

That’s despite multiple instances of people complaining on social media that collectors had continued to pursue them despite their having submitted, and even of collectors complaining that their data on who had submitted forms was out of date.

The internal admission of a “crisis” within the ABS about the census contradicts its public insistence that all is well with the census and that, if anything, return rates are ahead of where they were in previous censuses.

Under the Census and Statistics Act, census collectors have extraordinary powers to enter any building except immediate residential premises without a warrant. While there is no legislative power to physically enter residential premises, people have reported on social media collectors trying to open locked doors and, in at least one case, entering a rural residence while the resident was absent……..

Senator Scott Ludlam, on 1 September concerning a matter he will put before the Senate on 12 September 2016:

NOTICE OF MOTION 1 September 2016

I give notice that on the next day of sitting I shall move that -
The Senate -                                                     
1.       Notes
a.       the technical failures of the ABS website on census night - August 9th 2016 - prevented thousands of people completing the census;
b.      subsequent attempts to address the technical failures further added to confusion and impacted public confidence in the census process;
c.       the census website was offline for several days after census night, and sporadically offline in the following weeks;
d.      thousands of Australians were unable to complete the census, and thousands of Australians were reluctant to do so due to privacy concerns.
2.       Calls on the government to direct the Australian Bureau of Statistics to issue a statement declaring that no Australians will be fined for failing to complete the census.



Australian Bureau of Statisticsmedia release, 5 June 2014:

ABS announces planned changes to future work program

The acting Australian Statistician, Jonathan Palmer, today announced planned reductions to the Australian Bureau of Statistics (ABS) work program.

The ABS must reduce expenditure by about $50m over three years. While the ABS has been able to implement efficiencies in its operations, these are insufficient to meet the expenditure target. As a result, the statistical work program will be reduced from 2014-15. 

Mr Palmer said the revised work program, developed after consultation with key Australian Government agencies, will continue to meet Australia’s core statistical needs.
“Our highest priority was to maintain activities that are critical to effective government decision making and deliver the most public benefit.

“While the revised forward work program retains core statistical elements and outputs, we have had to discontinue or reduce outputs in areas that are valued by the users of those statistics. If funding is provided for the work we are ceasing, we will reinstate it.

“The quality, integrity and relevance of our statistics are critical to informing effective decision making and we must not lose sight of that as we plan for the future,” Mr Palmer said.

The work program changes, which will be implemented from 1 July 2014, are:

Discontinue
Environment collections from Australian Households
Waste Account
Measures of Australia's Progress
Australian Social Trends
Survey of Tourist Accommodation
ABS funded component of Culture, Sport and Recreation statistics 

Reduce
Industry statistics research, development and reporting in selected areas
Social conditions statistics research, development and reporting in selected areas
State and territories statistical services engagement and analysis activities
Regional statistics analysis and development
Macroeconomic research and development engagement in international activities
National information and referral services response times
External statistical education development programs

Review
Review the House Price Index, with the view to discontinuing it pending identification of alternative sources to meet the Australian National Accounts and other requirements

Further details of the work program changes will be advised to affected users in due course.
As Australia’s national statistical agency, the ABS provides official statistics on a wide range of topics relevant to government, business, and the Australian population.

Dept. of Prime Minister & Cabinet, PUBLIC SECTOR DATA MANAGEMENT IMPLEMENTATION REPORT, July 2016:

Overview
On 3 December 2015, the Department of the Prime Minister and Cabinet (PM&C) released the Public Sector Data Management Report.
Since then, significant progress has been made to implement the recommendations of the report. This Implementation Report outlines the outputs and initiatives that have been undertaken to date to meet the recommendations of the report and further the public data agenda.
The Australian Government remains committed to effectively managing, sharing and publishing public data as a national resource for the benefit of the Australian people.
As the lead for public data policy, PM&C continues to work closely with government agencies, states and territories, research organisations, industry and the public to maximise the use and reuse of public data across the whole economy……

Recommendation 9
Establish a linked Commonwealth dataset with a domain for secure access by government and researchers, providing:
* a collection of linked administrative and survey data that links across time and across sectors;
* data linkage conducted by accredited integration authorities (ABS); and
* streamlined access to aggregate and individual data, while maintaining appropriate protection of individuals’ records……

Multi-Agency Data Integration Project (MADIP)
The Multi-Agency Data Integration Project (MADIP) is a collaborative cross-portfolio partnership to improve accessibility to, and maximise use of, public data. Commonwealth data custodians are working together to establish processes for sharing and safe dissemination of linked data.
The MADIP partner agencies include the Department of Social Services, Department of Health, Department of Human Services, Australian Taxation Office and the Australian Bureau of Statistics (ABS).
A 2011 snapshot dataset has been created and is currently being analysed and evaluated by nine partner agencies in-posted to the ABS.

Trusted Access Model
One component of the MADIP is the Trusted Access Model for microdata access.
This model seeks to enable users outside the ABS, such as researchers, to use the data while maintaining the privacy of individuals represented in the data.
A ‘privacy-by-design’ access approach is used, which aims to build trust in the use of public sector data and balance the need for information with the need to maintain the privacy of individuals.

Data integration and linkage projects
The ABS is working on a number of data linkage projects to produce valuable linked datasets.
These projects include the Expanded Analytical Business Longitudinal Database and the Linked Employer-Employee Database.
These enduring, linked datasets combine high value data sources to better support policy development through research and informed discussion.

The ABS has commenced trials of a virtual DataLab with a number of agencies to provide trusted access to microdata. The DataLab is a platform from which to fully implement trusted access in 2016/17……

Little Bird Network, 14 August 2016:

This powerpoint presentation is published by the Public Data Branch of the Department of Prime Minister & Cabinet under the CC by 4.0 licence.

This presentation outlines in detail the plans of the Department of Prime Minister and Cabinet to use de-anonymised Census data to integrate with administrative datasets, including that it has already been doing this for some years with a sample of Census data (Appendix 5). This plan was published prior to the ABS public ‘consultation’ (carried out between November and late December 2015) required to determine whether or not Australians agree with de-anonymisation of the Census for the purpose of these data linkage projects which suggests that the decision had already been made by the Department of Prime Minister & Cabinet without public consultation to authorise it.

The public consultation that was carried out by the ABS over 5 weeks in late December was not advertised or reported in any media. The presentation also indicates that while the ABS is the integrating authority (the agency with the legislative authority to create data linkage projects), DPM&C appears to be the lead agency. Commentary regarding who is responsible for recent and significant changes to the Australian Census should be considered in light of the information in this presentation.

Power point presentation here.


Computer World, 8 September 2016:

The government is preparing for a major overhaul of its open data portal, Data.gov.au.

The current Data.gov.au site is based on the open source CKAN data portal software. 
The site launched in 2013.

The Data Infrastructure and Government Engagement (DIGE) team within the Department of the Prime Minister and Cabinet’s (DPMC) Public Data Branch has partnered with the CSIRO’s Data61 for the overhaul. The Public Data Branch is a product of a 2015 fusion of the Department of Finance’s open data team, the Data Policy Branch and the Department of Communication’s Digital Government Strategy.

Data61 is planning to release a first prototype of the new portal later this year. The initial prototype is expected to offer improved searching across multiple data repositories. Further prototypes will be released in 2017 “focussed on data publishing, data quality, better spatial publishing, and integration” according to a blog entry by the DPMC’s Toby Bellwood.

Under the government’s National Innovation and Science Agenda Data61 has been tasked with employing “data analytics to connect disparate government datasets and publicly release them on open data platforms”.


The organisations is currently the subject of a Productivity Commission inquiry. A draft report of the inquiry is expected in November, ahead of a final report in March 2017.

Australian Bureau of Statistics, job advertisements, September 2016:


Canberra Office, Belconnen, ACT
Executive Level 1 ($94,933 - $109,741)
Ongoing Position

The Australian Bureau of Statistics (ABS) is looking to engage an innovative Media Manager who will lead, in partnership with the Director, the Corporate Communications team in promoting the ABS as a world leading national statistical office, and support the use of statistics for informed decision making by governments and the community.

As Australia's national statistical agency, the ABS produces official statistics that inform important decisions made by government, business and the community.

The Corporate Communications Section is responsible for ABS’ enterprise communication internally and externally. The Section manages key internal and external channels, associated content and contributes to strategic external partnerships such as the media and ministerial liaisons.

About the Position:
Working in partnership with the Corporate Communications Director, the successful applicant will manage a team of diverse communication professionals to promote the ABS as a world leading national statistical office and support the use of statistics for informed decision making by governments and the community.

The Media Manager will be accountable, under broad direction, for the ABS’ media activities, including the documentation of communication plans, drafting media releases, producing social media and managing media relations.

The role involves working with both internal and external partners to help achieve the corporate goals of the ABS, and assist in the development of strategies and procedures to ensure best practice communication. This role also involves working with the ABS senior executive on internal and external communication.

Qualifications and Experience:
*Experience in managing media and communication operations and teams
* Highly developed communication, influencing and interpersonal skills
* Ability to prepare high-quality and innovative communication materials
* Strategic stakeholder management and engagement
* Flexibility, initiative and organisational skills to work effectively in a small team to tight deadlines

Relevant tertiary qualifications or suitable experience and skills are essential, including specialist fields such as Journalism, Social Media, Communications, Marketing and or Public Relations.

Application process
Applications open Thursday 8 September 2016, and may be submitted by Wednesday 22 September 2016. For further information please refer to the Applicant Information Kit.

Help and Contact Information
If you require technical help submitting your application, please contact ABS Recruitment on 1800 249 583.

For any questions related to this role, please contact Tasma Vyver on (02) 6252 7968 or email tasma.vyver@abs.gov.au

The ABS encourages and values a diverse workforce. Aboriginal and Torres Strait Islander people and people with disability are encouraged to apply. The ABS is committed to improving the gender diversity of its leadership.

2016 Census Field Officers closes 11 September 2016 11:30 PM (AEST)
*Various non-ongoing positions available Australia wide
*Salary: $21.61 per hour (inclusive of 25% loading)
*Opportunity to work in your local community

Twitterverse copies of documents coming out of FOI requests :
Image:@ellipsii
Image: 

Image: @unfiler & @seanparnell
Image: @Asher_Wolf

File this one under it had to happen:




Tuesday 6 September 2016

Senate Inquiry into Australian Census 2016: your chance to finally have a say on the ABS, personal privacy, data retention and #CensusFail



On 31 August 2016, the Senate referred an inquiry into the 2016 Census to the Senate Economics References Committee for inquiry and report by 24 November 2016.

The Inquiry terms of reference are:

The 2016 Census, with particular reference to:
  1. the preparation, administration and management on the part of the Australian Bureau of Statistics (ABS) and the Government in the lead up to the 2016 Census;
  2. the scope, collection, retention, security and use of data obtained in the 2016 Census;
  3. arrangements, including contractual arrangements, in respect of the information technology aspects of the Census;
  4. the shutting down of the Census website on the evening of 9 August 2016, the factors leading to that shutdown and the reasons given, and the support provided by government agencies, including the Australian Signals Directorate;
  5. the response rate to the Census and factors that may have affected the response rate;
  6. privacy concerns in respect of the 2016 Census, including the use of data linking, information security and statistical linkage keys;
  7. Australia’s Census of Population and Housing generally, including purpose, scope, regularity and cost and benefits;
  8. the adequacy of funding and resources to the ABS;
  9. ministerial oversight and responsibility; and
  10. any related matters.

Submissions close on 21 September 2016.

Address for submissions:

Senate Standing Committees on Economics
PO Box 6100
Parliament House
Canberra ACT 2600

Phone: +61 2 6277 3540
Fax: +61 2 6277 5719
economics.sen@aph.gov.au

Online submissions may be lodged here.

Friday 2 September 2016

Australian Census 2016 stumbles on.....


The Australian reports on the desperation of the Australian Bureau of Statistics to achieve the numbers required to legitimize census results, 29 August 2016:

The Australian Bureau of Statistics’ grand experiment with digital technology has entered a new phase, asking more than 25,000 census collectors to use their own smartphones and tablets in a blitz of 3.5 million households that have failed to return their questionnaires.

In one of the world’s largest “bring-your-own-technology” enterprises, more than 500 varieties of smartphone and tablet have been registered to track which homes have been visited and what hazards collectors should expect when they arrive.

The initiative is part of an ABS effort to match the 98.3 per cent coverage achieved by the census in 2011 — a target the federal opposition suspects is now out of reach amid public panic over privacy concerns and website outages in its early stages.

Census chief Duncan Young said the census field collectors had been equipped with Apple iOS and Android applications instead of the hefty bound books issued to census collectors in previous years. Mr Young downplayed the system’s vulnerability to cyber attack, saying collectors faced strict security hurdles before being allowed access to the system……

If this exchange is correct in its details then something is seriously wrong with the attitude and actions of the Australian Bureau of Statistics, the Turnbull Government and, with  Australian society if it tolerates this behaviour.

          1.    Amy Gray @_AmyGray_  Aug 22
Census collectors came to my place last week. They knocked on and then tried to OPEN my door. Another #CensusFail
          2.   kelloveslife @kelloveslife  Aug 26
@_AmyGray_ I came home Sat evening to find a card ON MY DINING TABLE that the census person had left!
          3.    Amy Gray @_AmyGray_  Aug 26
@kelloveslife No one had let them in?
          4.   kelloveslife @kelloveslife  Aug 26
@_AmyGray_ no one was home except the dog & cat
          5.    Amy Gray @_AmyGray_  Aug 26
@kelloveslife Just to confirm: no one who lives in your home took materials from or let in a census worker?
;          6.  kelloveslife @kelloveslife  Aug 26
@_AmyGray_ AFAIK no, there was nobody home all day
          7.  Amy Gray @_AmyGray_  Aug 26
@kelloveslife Have you asked the other people in your house? Sorry, just trying to confirm and edge out any potential deniablity from them.

       kelloveslife@kelloveslife


9:21 AM - 26 Aug 2016

Saturday 27 August 2016

Tweets of the Week



This tweet is by a journalist with The Age & The Guardian newspapers



This tweet is by an ABC TV journalist/news & current affairs presenter


Monday 15 August 2016

The fallout from #CensusFail continues......


It is now the sixth day after Cenus Night 2016 in Australia and information has been slowly seeping out into the public domain.

First there's the genuine attempts to explain the spectacular failure to launch as opposed to the ABS-Turnbull Government propaganda on the subject.......

Reddit user mykro76 via @Qldaar, 10 August 2016:

Sortius, 10 August 2016:

So, I contacted Softlayer support, this was their response @ABSCensus #CensusFail


Patrick Gray at Risky.Biz on #CensusFail, 11 August 2016:



Community and Public Service Union, media release, 12 August  2016:

ABS STAFF ANGRY AT TURNBULL GOVERNMENT OVER CENSUS DEBACLE

The CPSU says the highly qualified and dedicated staff at the Australian Bureau of Statistics must not be blamed for the decisions by the Turnbull Government that are the real cause of Tuesday night’s Census debacle.

The union’s National Secretary Nadine Flood said: “Our members working in the ABS have slugged their guts out for months to make this Census work despite multiple Government decisions that have caused major problems. They know how critical the information collected in the Census is to the nation and they’re absolutely gutted at the damage done to the ABS's reputation and the Census itself.”

“Staff saw these problems coming a mile off. There are 700 fewer staff at the ABS now than when the last Census was conducted five years ago and as a result staff are suffering under massive workloads. Critical planning time was lost as the Government foolishly considered axing the Census, chopped and changed ministers three times and dilly-dallied for nearly a year in appointing a new chief statistician.”

“It’s shameful that Prime Minister Malcolm Turnbull has said ‘heads will roll’ at the ABS over the Census while taking no responsibility for the real cause of this debacle, the decisions made by his Government.”

“It is Governments that are responsible for the reliability of public services and the Turnbull Government cannot dodge responsibility for slashing budgets and jobs. Prime Minister Turnbull should be apologising not finger pointing.”

“This situation in the ABS is just one example of how cuts to public sector staffing and capacity have gone too far, and how it’s ultimately the Australian public that suffers as a result.

Australians are struggling to get through on the Census hotline today, but that’s no less disturbing than the one in three calls to Medicare and Centrelink that go unanswered every day.”

“The dedication of ABS staff has ensured the Census has played a critical role in public policy in Australia for more than a century. It remains an important tool and we are urging Australians to participate despite the Government’s failings.”

Unsurprisingly the privacy concerns haven't gone away........

Digital Rights Watch, 12 August 2016:

The letter, signed by prominent privacy advocates, academics and journalists, reads:

The conduct of this year’s census raises serious and pressing ethical, legal, security and technological concerns. These throw doubt on the value of the exercise and the quality of the data collected.

The Australian government must put the Census 2016 on hold while it consults with the Australian people on the value and ethical ramifications of this and similar mass data-collection exercises. Expert input and advice must be sought to determine best practice ethical, governance and security standards for data collection, use, linkage, storage, and real-world implementation.

These problems, and the difficulties Australians have experienced in accessing and completing both the paper and electronic forms, make imperative the provision of the following two remedies.

We therefore respectfully request:
1. Amnesty for anyone who files a late or incomplete census
2. An independent inquiry into the ABS’s conduct of Census 2016. This should include a comparison of the ethical and institutional governance arrangements for hard-copy and electronic data collection, storage, linkage and use with international and best practice standards. Community consultation should take place in regard to the appointment of heads of this inquiry, precise terms of reference and timeframes for reporting.

Signed by:

Tim Norton, Digital Rights Watch
Amy Gray, Digital Rights Watch
Asher Wolf, journalist
Dr Suelette Dreyfus
Peter Tonoli
Jenna Price
Liam Pomfret, Australian Privacy Foundation
Mark Walkom, Australian Privacy Foundation
Simon Frew, Pirate Party Australia
Felicity Ruby, PhD Candidate
Professor Ariadne Vromen
Tim Cashmere
Mary Kostakidis, Freelance Journalist
Gautam Raju, Campaigner
Jack Skinner
Dr Leslie Cannold
Melissa Castan, Law Lecturer
Dr Ben Harris-Roxas
Professor Robert Sparrow
Robin Doherty, Hack for Privacy
Dr Kristoffer Greaves, Legal Educator
Archie Law, CEO ActionAid Australia
Thomas Kane
Kate Galloway, Law Lecturer
Tom Sulston, Technology Consultant
Trisha Jha
Suzy Wood, IP Lawyer
Justin Clacherty, Future Wise Australia
Cade Diehm, SpiderOak
Trent Yarwood, Future Wise Australia
Julian Burnside AO QC
Dr Matthew Rimmer, Professor of Intellectual Property and Innovation Law, QUT Faculty of Law
Dan Nolan, software engineer


Then there's those zealous casual employees on the ABS Census team attempting to salvage something from the wreckage…….


The mocking has even spread into mainstream media on Northern Rivers…….

The Daily Examiner, 13 August 2016:

SORRY guys, looks like we caused the Census website to crash, but it was worth it.
We only told one little lie but suddenly our street is crawling with engineers, government types, teachers, plumbers, interpreters, shopping centre magnates and consultants.
Man, we haven't seen so many consultants since they sold Telstra.
Anyway, it was all part of objecting to have to put your name on the Census.
Not sure why we're objecting, everyone knows me and I would be happy if someone stole my identity. I could just slip away quietly and watch the fireworks.
They are as welcome to the $10 in my bank account as they are to my dog, and well, truth be known, Ms L. probably would appreciate the change too, and it'd be cheaper than a holiday for her.
But if it's not good enough for Nick X, then it's not good enough for us, so I didn't use my name.
However I did say that there were 23,000 people staying at our place that night and that's when the fun started.
We ensured half the number were children so the Education Department has acquired land for a primary school, a high school, half a TAFE and a branch of some wannabe regional uni, all within a kilometre.
Westfield is knocking down the other houses in our neighbourhood and building a shopping centre.
The Department of Transport built a bus interchange across the road (guess we didn't make the cut for an airport, but gee it gave Badgerys Creek a fright).
There's a new hospital with no queues on a Saturday night. However that might be because of the lockout laws. Yeah, we didn't see that coming. Apparently when you get that many people together they want to stay up late and party. Well, der. But this is Australia, mate, not Paris or Berlin, New York or London.
We're locked out after dark and the internet doesn't work, but gee the other services are good and I'll drink to that. BYO at home, that is.
Sorry about the website thing.

An important point that shouldn't be lost in all the media noise........
Finally, an estimation of how many premises and or households are still missing in action (including an unknown number involved in acts of civil disobedience)......

It is possible that as of today the Australian Bureau of Statistics only holds an est. 30-45 per cent of all Census forms (paper & online) it anticipated receiving.

The statistical margin of error flowing from that sort of respondent percentage would be too large to make it a credible national snapshot of population and housing.