The AI Reader.
What Could Go Wrong

Tesla's lawyers said Elon Musk's recorded words might be a deepfake

The denial that a real recording is a deepfake is already being tried in court and campaigns, and the only experiment to test it found it works on text scandals but largely fails on video, the very evidence it was meant to discredit.

Why this matters

You keep hearing that deepfakes will destroy our ability to believe anything we see or hear. That claim actually holds two worries, and they are faring very differently. One is that a flood of convincing fakes will fool people at scale, enough to swing an election or set off a panic. The other is quieter, and it has a name: the liar's dividend. Once everyone knows a recording can be faked, a person caught on a real one can simply call it fake. This lesson takes both at full strength, from the people who first raised them, then checks each against what has happened: the 2024 elections, a Tesla courtroom, and the one experiment that has tested whether the tactic works. By the end you should be able to state each worry precisely and say how far the evidence backs it.

Background optional reading
01
GPT-4 shifted opinions more than humans did, once it knew who it was arguing with: the separate question of whether an AI can actually out-argue a person, which this lesson leaves aside.
02
Everyone on the video call was a deepfake except the Arup employee who wired HK$200 million: one case where a deepfake did fool someone who mattered.
03
The FCC's $6 million fine over the Biden robocall survived Steve Kramer's acquittal: a cloned voice used against an actual election, and what it cost to make.

How the liar's dividend got its name

Before the 2016 election, a technologist named Aviv Ovadya gave a talk to Bay Area colleagues that he called "Infocalypse." He was not warning about a particular fake. He was warning that the tools to fabricate convincing audio and video were arriving, and that once they did, the damage would not stop at any single forgery. The question he kept returning to, in the reporter Charlie Warzel's account, was "what happens when anyone can make it appear as if anything has happened, regardless of whether or not it did?"1 His subject was synthetic media: audio, images, or video produced or altered by software rather than captured from the world.

Ovadya put the stake plainly in his own writing. In the Harvard Business Review in 2018, he argued that the coming wave "won't just impact our elections. It will impact our ability to trust just about anything we see and hear."2 A year later, in MIT Technology Review, he and a co-author held that the same tools that entertain "can also enable deception with global ramifications." They rejected the shrug that there has always been deception. What had changed, they argued, was the degree and the impact.3

The sharpest version of the worry was named in 2019 by two law professors, Bobby Chesney and Danielle Citron, in a California Law Review article, "Deep Fakes: A Looming Challenge for Privacy, Democracy, and National Security."4 A deepfake, in their sense, is synthetic media that convincingly shows a real person saying or doing something they did not. Their article named two distinct dangers. The first is the flood of fakes: convincing forgeries produced cheaply enough to deceive people in bulk. The second is subtler, and it was their own contribution. Fakes do harm even when no fake is made. Once the public knows a recording can be faked, anyone caught on a real recording can escape it by claiming it is fake. They called the payoff the liar's dividend, and they noticed a trap inside it: the better the public understands deepfakes, the more readily that denial is believed.

The paradox they named
"Hence what we call the liar's dividend: this dividend flows, perversely, in proportion to success in educating the public about the dangers of deep fakes."4 Chesney and Citron, California Law Review, 2019

What the 78 catalogued AI uses in 2024's elections turned out to be

Dozens of countries held national elections in 2024, the first such year with cheap generative tools in general reach. The prediction was a flood. Two Princeton researchers, Sayash Kapoor and Arvind Narayanan, read every one of the 78 uses of AI in elections the WIRED AI Elections Project had catalogued.5

78AI uses logged, 2024 elections
39of them not meant to deceive
~7×cheap fakes per AI fake

Of the 78, 39 carried no intent to deceive: satire, labeled campaign art, illustration. Of the 22 uses by candidates or supporters, 19 aimed to improve campaign materials rather than mislead. The genuinely deceptive examples could mostly have been made without AI for a few hundred dollars. And the fakes that spread furthest were not AI at all but cheap fakes, meaning real footage relabeled or crudely edited by hand. By the News Literacy Project's tally, cited in the same analysis, cheap fakes ran to roughly seven times the AI ones.5 That figure is theirs, and I am reading it secondhand. No study of the year, theirs included, found a single AI fake that measurably moved a result.

Kapoor and Narayanan are the serious skeptics of the whole alarm. Their point is that the flood was never the real mechanism. Misinformation, they argue, is pulled by demand rather than pushed by supply. People seek out claims that flatter what they already believe, so producing such claims more cheaply changes little. Whether an AI can actually out-argue a person is a separate question, and an earlier lesson took up the one trial that has tested it.

Sayash Kapoor and Arvind Narayanan, Princeton Position

Political misinformation is not an AI problem.

Misinformation is demand-driven. Audiences consume the claims that fit their existing beliefs, so cheaper synthetic supply adds little the demand was not already meeting.5

Their own honesty cuts the other way. Their count of deepfakes was small. That "could either indicate that AI deepfakes are a much smaller problem so far than anticipated," they note, "or that the database has many missing entries."5 So the case rests on a tracker that may undercount. But undercounting cannot rescue the strong prediction, which was about swung votes, and no measured swing has turned up.

In court, the "it's a deepfake" defense has already been tried

The second worry has fared differently, because it does not need a flood. It needs one person with something to hide and a way to call a recording fake. That move has already reached a courtroom. In Huang v. Tesla, a wrongful-death suit over a fatal 2018 Autopilot crash, the plaintiffs wanted to question Elon Musk about recorded 2016 statements in which he touted Autopilot's safety. Tesla's lawyers argued the recordings might be deepfakes, and that Musk therefore should not be compelled to sit for questions about them.6 Judge Evette Pennypacker refused. She called the argument "deeply troubling," and read their position as holding that "because Mr. Musk is famous and might be more of a target for deep fakes, his public statements are immune." She ordered a narrow three-hour deposition, limited to authenticating whether he had said the words. This is the liar's dividend in the exact form Chesney and Citron feared: real, recorded words waved away as possibly fake to dodge accountability.

A looser instance came from politics. In August 2024, Donald Trump posted that a photograph of the crowd at a Kamala Harris rally was AI-generated, and that no crowd had been there. The rally drew about 15,000 people by the campaign's count, documented by wire agencies. The forensics researcher Hany Farid found no sign the image was generated, and PolitiFact rated the claim its lowest, "Pants on Fire."7 It fits the pattern, but differs from the Tesla case: the photo showed a rival's crowd, not Trump's own recorded conduct, a weaker fit for the paradigm of escaping one's own acts.

The tactic is also older than deepfakes. The Brennan Center's review records earlier instances of the same denial. A Spanish minister dismissed real images of police violence in Catalonia as "fake photos" in 2017. Trump himself called the Access Hollywood tape "not authentic" in 2017.8 I am reporting those as the Brennan Center reports them, not from each underlying record. They change the reading of Chesney and Citron's claim in one way. Deepfakes did not invent the cry of fake. They lower its cost and raise its plausibility, a change of degree rather than a new move. The Brennan Center's own answer is to make authenticity easy to prove: provenance standards that tie a file to a verifiable origin, newsrooms that pre-empt fakes, and norms against candidates who falsely cry fake.8

The one experiment found it weakest where the fear is sharpest

The move being tried is not the move working. The Tesla judge rejected it, and the Trump claim was debunked. Neither tells us whether the denial changes what audiences believe. Only one controlled study has tested that. Kaylyn Jackson Schiff, Daniel Schiff, and Natalia Bueno ran five pre-registered survey experiments with more than 15,000 participants. Each showed people a politician hit by a scandal, then a false claim that the evidence was misinformation.9 They tested two versions of the denial: informational uncertainty, which says the evidence might be fake and no one can be sure, and oppositional rallying, which says enemies fabricated it. Both beat apologizing or staying silent, and both worked across party lines.

The payoff turned on the scandal's format. The denial raised a politician's support when the scandal was reported in text. It was largely ineffective when the scandal came with video.

The false "it's fake" claim, tested against the same scandal in two formats.9
Scandal format What Chesney and Citron feared What the experiment measured
Text Not their central case; the dividend was meant for recordings. Support rose, and stated opposition fell from 44% to 32–34%.
Video The dividend at its strongest, because faked video was their central case. Largely ineffective; the denial did not reliably move support.

Chesney and Citron feared the dividend most for genuine audio and video, the material deepfakes can imitate. The only experiment to test the tactic found it worked least well there. In the authors' summary, "false claims of misinformation do pay a liar's dividend, but primarily (if not exclusively) when used against scandals reported in text format."9 The Tesla and Trump episodes show the move being attempted. This study is the reason not to assume it lands on an audience.

The takeaway

Keep the two worries apart, because the evidence rates them differently. The flood of fakes was the loud prediction for 2024, and it did not arrive. The fakes that showed up were mostly not meant to deceive. Cheaper hand-made fakes were far more common, and no one has found an AI fake that moved a result. The liar's dividend is the quieter worry, and it is the one turning up in real disputes, from a Tesla courtroom to a candidate's feed. But "the move is being tried" is not "the move works." The only experiment that has tested it found it pays off against written accusations and largely fails against video, which is the evidence its inventors feared it would destroy. So the tactic is real and it is being used. The one thing anyone has measured says it works least well exactly where the alarm was loudest.

Go deeper optional reading
01
Chesney and Citron, "Deep Fakes: A Looming Challenge for Privacy, Democracy, and National Security": the full argument, including the harms this lesson set aside.
02
Kapoor and Narayanan, "We Looked at 78 Election Deepfakes": the case-by-case count behind the flood-of-fakes verdict.

Sources

  1. BuzzFeed News · Charlie Warzel, "He Predicted The 2016 Fake News Crisis. Now He's Worried About An Information Apocalypse."
  2. Harvard Business Review · Aviv Ovadya and Hal Bienstock, "Is Your Company Ready to Protect Its Reputation From Deepfakes?"
  3. MIT Technology Review · Aviv Ovadya and Jess Whittlestone, "Ethical Deepfake Tools: A Manifesto"
  4. California Law Review · Bobby Chesney and Danielle Citron, "Deep Fakes: A Looming Challenge for Privacy, Democracy, and National Security"
  5. Knight First Amendment Institute · Sayash Kapoor and Arvind Narayanan, "We Looked at 78 Election Deepfakes. Political Misinformation Is Not an AI Problem"
  6. Fortune · "Elon Musk's Lawyers Argue Recordings of Him Touting Tesla Autopilot Safety Could Be Deepfakes"
  7. PolitiFact · "Why Trump's Claim That the Harris Campaign Used AI to Fake a Crowd Is Wrong"
  8. Brennan Center for Justice · Josh A. Goldstein and Andrew Lohn, "Deepfakes, Elections, and Shrinking the Liar's Dividend"
  9. American Political Science Review · Kaylyn Jackson Schiff, Daniel S. Schiff, and Natalia S. Bueno, "The Liar's Dividend: Can Politicians Claim Misinformation to Evade Accountability?"