CNET let an AI draft its finance advice under a staff byline
The in-house engine produced 77 stories, one of which told readers a $10,000 deposit at 3 percent would earn $10,300 in a year.
Why this matters
You read AI-written text constantly now, and you are usually told it is reliable. This lesson is about what happened the first time a major newsroom published it at scale without saying so. In late 2022 CNET ran dozens of personal-finance stories drafted by an in-house AI tool, and some of them gave readers wrong numbers stated with complete confidence. By the end you will be able to say why fluent machine-written prose can be confidently wrong, why its fluency is what let the errors through, and what a newsroom has to do that the software cannot do for itself.
- 01
- Why language models hallucinate: how a model states false things with full confidence.
- 02
- The Air Canada chatbot: a different shape of the same problem, where a chatbot answered one customer wrong.
An in-house engine under a staff byline
In November 2022, the money desk at CNET began publishing short personal-finance explainers written by an in-house tool the company called an AI engine. It was not ChatGPT. An editor sketched an outline, the engine drafted the article, and an editor was meant to expand and check it before it ran.1 Over the following weeks the desk published 77 of these stories, about 1 percent of everything CNET ran in the period.1
The stories covered the basics a reader might search for: what compound interest is, how a certificate of deposit works, what an APR means. Each one carried the byline "CNET Money Staff." A reader who hovered over that byline found a line saying the article had been generated with automation technology and edited by a human on the staff.2 Nobody outside the building had reason to look closer. The stories read like every other explainer on the site.
The error a reader could check
In January 2023, the technology site Futurism read the stories closely and found that several of them were wrong.3 One explained compound interest with a worked example. It told readers that $10,000 deposited at 3 percent annual interest would earn "$10,300 at the end of the first year."3 The number is wrong. At 3 percent, $10,000 earns $300 in a year. The $10,300 is the deposit and the interest added together, not the interest earned. A reader who trusted the sentence would overstate a year of savings by more than thirtyfold.
"you'll earn $10,300 at the end of the first year"3 CNET's AI engine, on a $10,000 deposit at 3 percent, as quoted by Futurism
Its neighbors carried errors of the same kind. On a $25,000 car loan at 4 percent, one story told readers they would pay "a flat $1,000 in interest per year," when the interest falls each year as the balance is paid down.3 Another said a one-year certificate of deposit compounds only once, at maturity, when banks typically compound such a deposit every day or every month.3
CNET later appended a correction to the compound-interest article. It said an earlier version "was assisted by an AI engine and it mischaracterized some aspects of CDs, savings accounts and loan payments," that the points were corrected, and that a staff writer had substantially rewritten the piece.4 The article now carries a named human byline.
The corrections, counted from outside
CNET's editor-in-chief, Connie Guglielmo, published an editor's note on January 25, 2023. She wrote that the desk had reviewed the stories and found some that needed fixing: "a small number requiring substantial correction and several stories with minor issues" such as incomplete company names or transposed numbers.1 She gave no total. The figure repeated everywhere since, that more than half the stories were corrected, did not come from CNET. The Verge counted the correction notes appended to the live articles and reported errors in more than half of them.5 Engadget put the count at 41 of the 77.6 That number is an outside tally of the published articles, not a figure CNET announced.
Futurism found that many of the AI's sentences closely tracked text already published elsewhere, including on Bankrate, a personal-finance site owned by Red Ventures, the same company that owns CNET.7 Where Forbes Advisor had written that "overdraft and NSF fees need not be the norm," the CNET story read "overdraft and NSF fees don't have to be a common consequence."7 The wording was changed just enough to cover the source.
CNET paused the tool. It changed the byline from "CNET Money Staff" to "CNET Money," moved the disclosure out of the byline hover so a reader could see it, and added a human editor's name to the pieces.1
-
Nov 2022
CNET's money desk starts publishing AI-drafted explainers1
The stories run under the byline "CNET Money Staff."
-
Jan 2023
Futurism reveals the program and its hidden disclosure2
Later reporting documents the factual errors and the borrowed phrasing.
-
Jan 25, 2023
CNET's editor publishes a note, pauses the tool, and makes the disclosure visible1
Outside outlets tally corrections on 41 of the 77 stories.
-
May 16, 2023
About 100 CNET workers unionize with the Writers Guild of America, East8
Their organizing statement names automation as a threat.
In May 2023, about 100 CNET writers, editors, and producers formed a union with the Writers Guild of America, East, and their organizing statement said that "automated technology threatens our jobs and reputations."8 Reporting at the time placed the AI episode among the reasons they organized, alongside layoffs under Red Ventures.9
Why the wrong number sounded right
An editor missed the interest error because it did not look like an error. A language model of this kind is trained to do one thing: predict the next word from the words before it, over and over, choosing what is statistically most likely to come next.10 Nothing in that process checks a figure against arithmetic or a claim against the world.
So the model wrote "$10,300" because that string was a plausible continuation, not because anything computed the interest. And a plausible continuation reads exactly as fluent when it is wrong as when it is right. The confidence in the sentence is not evidence about the number in it. A 2025 paper by researchers at OpenAI and Georgia Tech, "Why Language Models Hallucinate," made the general point plainly. Large language models "sometimes guess when uncertain, producing plausible yet incorrect statements instead of admitting uncertainty," the authors write. They argue the models do this because training and grading reward a confident guess over an admission of doubt.11 That paper came out two years after the CNET stories and says nothing about them. It describes the class of failure, not CNET's particular tool, whose design the company never published. The course covers this mechanism in its own lesson on why models hallucinate.
There is a second effect, and it is the one that turned a software limit into a publishing failure. A rough or hesitant draft invites scrutiny. Clean, confident prose does not. The polish that made the stories publishable is the same polish that made their errors easy to wave through.
This is what separates the CNET case from the AI failures that draw more attention. When a company's chatbot gives one customer a wrong answer, the mistake is a single exchange, and the reader knows a machine produced it. CNET published the machine's output as its own reviewed work, under a human-sounding byline, to everyone who searched the topic. That a model produced a false statement was ordinary. The failure was that a newsroom published it as vetted advice without the one step that would have caught it.
The takeaway
The CNET episode is the clearest early case of a failure you will keep meeting: fluent AI prose that is wrong and does not sound wrong. A model that predicts the next word will produce a confident sentence whether or not the number in it is right, and no part of that process checks the number. That is a limit of the tool. The failure at CNET was letting the tool's polish stand in for the check a person was supposed to do, and publishing the result as staff work without telling readers a machine had written it. What guards against that is not better-sounding output. It is a person verifying the claim, and a byline that says where the words came from.
- 01
- The Washington Post on the episode: a contemporaneous account of it as a journalism failure.
- 02
- Kalai et al., "Why Language Models Hallucinate": the full argument for why models guess instead of admitting doubt.
Sources
- CNET · CNET Is Testing an AI Engine. Here's What We've Learned, Mistakes and All
- Futurism · CNET Is Quietly Publishing Entire Articles Generated By AI
- Futurism · CNET's Article-Writing AI Is Already Publishing Very Dumb Errors
- CNET · What Is Compound Interest?
- The Verge · CNET found errors in more than half of its AI-written stories
- Engadget · CNET corrected 41 of its 77 AI-written articles
- Futurism · CNET's AI Journalist Appears to Have Committed Extensive Plagiarism
- Writers Guild of America, East · CNET Media Workers Unionize with the WGA East
- Futurism · CNET Staff Unionize, Saying AI Use "Threatens Our Jobs and Reputations"
- Brown et al. (OpenAI) · Language Models Are Few-Shot Learners
- Kalai et al. · Why Language Models Hallucinate