Robodebt built debts from averaged income, then made recipients disprove them
Removing a per-file human check let the same averaging error scale to $1.763 billion asserted against roughly 433,000 people, until a federal court and a royal commission found it unlawful.
Why this matters
Governments and companies increasingly let an automated system decide that you, specifically, owe money or broke a rule, and then ask you to prove otherwise. Robodebt is the clearest worked example of where that design fails. Between 2015 and 2019 the Australian government raised welfare debts against hundreds of thousands of people by averaging their yearly income into fortnights and demanding they disprove the result. It was found unlawful and cost more than a billion dollars to unwind. The easy story is that an algorithm ran amok. What actually broke was older than the software, and versions of it still run in systems that never made the news. By the end you will be able to say what income averaging is, why reversing the burden of proof turns a small error into a mass one, and how to spot the design before it is automated at scale.
- 01
- The Dutch tax office turned a non-Dutch passport into a fraud score: the same bargain, a risk model plus a reversed onus, run against families in the Netherlands.
- 02
- nH Predict sets one patient's discharge date from six million others: how an average built from other people becomes a cap on one.
A debt the recipient had to disprove
In July 2016 the Australian government's Department of Human Services began sending letters asserting a welfare debt and asking the recipient to log in and explain it. No one had checked the figure. It came from a computer that matched two records: what a person had told Centrelink they earned, fortnight by fortnight, against what their employers reported to the tax office for the whole year. Where the two disagreed, the system raised a debt and moved to recover it, garnishing tax refunds and handing accounts to debt collectors.1
Reviewing overpayments was ordinary work. Welfare depends on income, and someone who earned more than they declared can owe the difference back. What was new in Robodebt was the arrangement: the government produced a number, called it a debt, and made the recipient prove they did not owe it.
How dividing a year made a fortnight
Australian welfare entitlement is assessed fortnightly: what you are owed in any two-week period depends on what you actually earned then. The tax office reports income the other way, as a single aggregate figure for the whole year, which cannot say what a person earned in any particular fortnight.2
Robodebt bridged that gap by division. It took the annual employer-reported total and, in the Royal Commission's words, “divided up evenly, and allocated into the number of fortnights included in the period being reviewed,” then treated that flat, invented figure as the person's income in every fortnight.1
The arithmetic is on the record in one recipient's case. For the 2011–12 year, Deanna Amato's employer reported $24,811 in income to the tax office. Robodebt divided that by the 366 days in the period, reaching $67.79 a day, then multiplied by 14 for an “apportioned fortnightly income” of $949.05. That flat figure replaced what she had actually reported earning each fortnight. The sum assumed she had earned the year's income in equal fortnightly amounts, and her own reported earnings showed she had not. It produced a debt of $2,924.28, and the tax office was ordered to hand over her refund to cover it. A federal court later declared the demand “was not validly made”: there was “no probative material” for the assumption, and her own figures contradicted it.3
The department's own guidance had predicted this: averaging over 12 months “will not result in a correct result if the customer should have received a full rate at other times of the year.”2 Averaging did not always invent the whole debt. The Commonwealth later accepted that Amato owed something, though “very substantially smaller” than the sum demanded. What averaging invented was the amount.3
The check that used to catch it
Income averaging did not arrive with the computer. The department had used it for years, but only as a last resort and often with the recipient's agreement, after asking for their actual records.2 What Robodebt changed was who did the checking, and whether anyone did.
Before, a flagged discrepancy went to a compliance officer who examined the file, contacted the recipient, and could compel the employer to hand over the actual pay records for the period. About 20 000 files a year were checked this way.1 That officer caught a wrong average before it became a debt. Robodebt removed the officer. Under the fully automated system, if the recipient did not go online and supply the evidence, the department would “no longer use its information gathering powers to obtain it directly from employers.”2 The averaged figure stood, and disproving it fell on the person least able to make an old employer dig out years-old records.
Even staff who wanted to intervene often could not. A welfare advocate told a Senate committee that when a client's debt recovery was supposed to be paused, the department explained: “The computer is initiating these calls and they can't be overridden. The best we can do is reduce the amount that she has to repay.”4
| Step | Before the automated system | Under Robodebt |
|---|---|---|
| Income figure | Officer sought the employer's actual pay records for the period. | Annual tax-office total divided evenly across the fortnights. |
| Averaging | A last resort, often with the recipient's agreement. | The automatic default when the recipient did not respond. |
| Onus | The department gathered the evidence for the debt. | The recipient had to disprove the figure or owe it. |
| Penalty | Raised on the facts of the case. | A 10 per cent penalty added automatically. |
The error rate per file may have been no worse than before. The scale was. In the manual program that ran just before full automation, reviews rose roughly fivefold in a single year, and about nine in ten of the debts it raised used averaging.1 Removing the human check did not invent the error. It mass-produced it.
What it cost and how it ended
In the class action Prygodicz v Commonwealth, the Federal Court found the Commonwealth “unlawfully asserted such debts, totalling at least $1.763 billion against approximately 433 000 Australians.” It had already recovered about $751 million from roughly 381 000 of them.5 The Royal Commission put the refund program at $746 million reimbursed to some 381 000 people, with debts totalling $1.751 billion written off.1 The two accounts measure different things at different times, not a disagreement.
The program had been sold as a saving. Budget papers projected about $2 billion over its first four years. Services Australia spent $606 million building it, and the savings never came.4
The human cost is on the record. The court recorded what group members reported: financial hardship, anxiety and distress, including suicidal ideation and in some cases suicide.5 The Royal Commission was aware that people with debts raised under the scheme had died by suicide, assigned no toll, and was explicit that causation is specific to each case.1 Even the death most associated with Robodebt, that of Rhys Cauzzo, came from a debt raised through the earlier manual process, not the online system. Both used averaging.1
Averaging is not unlawful in itself; using it as the sole basis to prove a debt is.1 Amato was one case. In Prygodicz the court reached the same conclusion for the whole class: a debt decision resting solely on averaged tax-office data, with no other evidence of actual fortnightly income, “was not validly made.”5 The two bodies differ on what officials knew. Ruling in 2021 on the record before him, Murphy J declined to find that ministers and senior public servants actually knew the scheme was unlawful, calling it closer to “a stuff up” than “a conspiracy.”5 The Royal Commission, working from a wider base in 2023, found the department had legal advice as early as 2014 that averaging this way was unlawful, and that senior people knew of it.1
Part of why the scheme survived was that an early review did not stop it. When the Commonwealth Ombudsman examined the system in April 2017, it did not reach lawfulness. It found the debts “accurate, based on the information which is available to DHS at the time the decision is made,” and said the fairness of the department's discretion “can only be answered by the courts.”2 The department then relied on that report as evidence that Robodebt was legal, and later worked to keep the legality issue out of the Ombudsman's follow-up.1
The retreat came in stages. In November 2019 the government announced it would stop raising debts on averaging alone,6 and days later the Federal Court's Amato consent orders held that averaged tax-office data could not by itself prove her debt.3 In May 2020 it announced it would refund debts raised wholly or partly on averaging, by then some 470 000 of them.6 The 2021 class action added a settlement of $112 million, inclusive of legal costs, on top of the refund program.5 A Senate committee majority, over a dissent from Government senators, recommended a royal commission. The government of the day did not adopt it, and the commission was established only after the 2022 change of government.4 When it released the Commission's report in July 2023, the government said it would consider the recommendations and respond in full.7 In September 2025 it agreed to a further $475 million to settle an appeal, Knox, still subject to Federal Court approval.8
“Robodebt was a crude and cruel mechanism, neither fair nor legal, and it made many people feel like criminals. In essence, people were traumatised on the off-chance they might owe money.”1 Royal Commission into the Robodebt Scheme, Final Report
Where the same bargain still runs
Robodebt stopped, but the system beneath it did not. Automated income data-matching between Centrelink and the tax office continued. The Ombudsman's 2021 report records that the online compliance system was replaced by later programs, one of which, Check and Update Past Income, “is still in operation.”6 What ended was the single move the courts struck down: using an average as the sole proof of a debt.
The weakness that carries beyond Robodebt is the bargain, not the software that ran it. A system takes a cheap signal, a data-match, a model's score, an average, treats it as proof of a fact about one person, then makes that person disprove it. The Dutch tax office made the same bargain with a fraud-risk model and drove tens of thousands of families into a dragnet they could not see or appeal. Only the signal changes. What stays is the shape: proof asserted cheaply, and the doubt made the citizen's to clear.
The takeaway
Robodebt did not invent a new kind of mistake. The averaging it relied on, and the reversed onus that made averaging dangerous, both predate it. What the automation changed was scale. Removing the compliance officer who checked each file turned a rare, correctable error into hundreds of thousands of debts. At least $1.763 billion was asserted against about 433 000 people before the courts and a royal commission called it unlawful. The failure was structural, not technological, and it did the most damage to the people least able to answer. When you next read that an algorithm wrongly flagged someone, ask the two questions Robodebt answers: what did the system treat as proof, and who was made to disprove it?
- 01
- Royal Commission into the Robodebt Scheme, Final Report, Volume 1: the Overview lays out the mechanism and the findings in the Commission's own words.
- 02
- Prygodicz v Commonwealth (No 2) [2021] FCA 634: the Federal Court's settlement-approval reasons, with the figures the parties proved.
Sources
- Royal Commission into the Robodebt Scheme · Final Report, Volume 1 (2023)
- Commonwealth Ombudsman · Centrelink's automated debt raising and recovery system (April 2017)
- Federal Court of Australia · Deanna Amato v The Commonwealth, consent orders (VID611/2019, 27 November 2019)
- Senate Community Affairs References Committee · Accountability and justice: Why we need a Royal Commission into Robodebt
- Federal Court of Australia · Prygodicz v Commonwealth (No 2) [2021] FCA 634
- Commonwealth Ombudsman · Services Australia's Income Compliance Program (April 2021)
- Prime Minister of Australia · Final report of the Royal Commission into the Robodebt Scheme (media release)
- Attorney-General's portfolio · Robodebt class action appeal settlement (media release, 4 September 2025)