The strongest evidence that AI deskills people is a single colonoscopy study
The idea that automating a job strips the skill behind it dates to 1983 and holds up for pilots and drivers, yet the loudest version now, that coding assistants erode your debugging, has never been measured.
Why this matters
Every time a tool takes over part of a job, the people who used to do that part get less practice at it. The worry is old and precise: the better the automation gets, the more it hollows out the very skill you would need the day it fails. That worry is being argued right now about doctors reading scans, students writing essays, and programmers who lean on a coding assistant. This lesson gives you the argument at full strength, then sorts the evidence into what has been measured and what is still a forecast, so you can tell which warnings rest on data.
- 01
- Trained operators keep deferring to automation that is wrong: the neighboring failure of over-trusting a specific automated output, often confused with deskilling.
- 02
- The famous 47% was never a prediction that jobs would vanish: the separate argument about jobs disappearing, not skill decaying in people still doing the work.
What Bainbridge saw in the control room
In 1983 Lisanne Bainbridge, writing about automated process-control plants, laid out a problem that has outlived every system she was describing.1 A designer automates every part of a task that can be done cheaply and reliably, and leaves the human the residue: watch the automation, and take over on the rare occasion it cannot cope. Those are the two hardest parts of the original job, and automation has just removed the daily practice that made anyone good at them.
Her point was mechanical. Physical skills decay when they go unused, and the knowledge behind a judgment gets slower to retrieve the less it is used. So the operator who once ran the plant by hand, and now only monitors it, is on the way to becoming one who cannot run it by hand. In her words, "a formerly experienced operator who has been monitoring an automated process may now be an inexperienced one."1
Automating the easy parts of a task can make the hard parts harder. The machine takes the routine work and leaves the person the monitoring and the rare takeover, then removes the practice those depend on. "By taking away the easy parts of his task," Bainbridge wrote, "automation can make the difficult parts of the human operator's task more difficult."1
Two further turns make it worse. Monitoring a machine that almost never fails is a task human attention is poorly built for: you cannot stay alert for hours against an event that comes once a year. And the more reliable the automation, the rarer the takeover, so the skill it demands is most decayed exactly when it is finally called on. Bainbridge's conclusion was that the most automated systems need the most operator training, not the least.1
The argument is strong, but it is reasoning, not measurement. Bainbridge was working from what she had seen on flight decks and in control rooms. Her paper is the origin of the idea and its most careful statement, but it predates the systems now in question by four decades, so whether it holds for any one of them the paper cannot say. It is also a claim about the skill, not the job. Whether automation destroys employment is a different argument. Deskilling is about the competence of the people still doing the work.
Aviation and GPS measured which skills decay
Outside AI, in domains automated for decades, the results are more specific than the slogan. Take the claim in its most familiar form: automation ruins a pilot's stick-and-rudder skills. In 2014 Stephen Casner and colleagues put 16 airline pilots in a Boeing 747-400 simulator and varied how much of the flying the automation did.2 The finding cut against the slogan. The pilots' hands were fine: manual control and instrument scanning held up even when they said they rarely practiced them. What degraded were the cognitive parts of flying, such as tracking the aircraft's position without the map display and noticing a failure, and that decline tracked how far a pilot's mind had wandered more than how little they had touched the controls.2
The clearest real-world case is Asiana Airlines Flight 214, which struck a seawall short of the San Francisco runway in 2013.3 It is often told as automation deskilling a crew into a crash. The report is more careful. The National Transportation Safety Board's probable cause is in-the-moment mismanagement: a mishandled descent, the pilot flying's unintended deactivation of the autothrottle's speed protection, inadequate airspeed monitoring, and a delayed go-around.3 Automation reliance appears there as one contributor to the monitoring failure, not as the cause. The crew let the airplane get low and slow because they trusted the autothrottle to hold the speed when, in the mode they had set, it would not.3 The board did find that regular hand-flying would have helped the crew catch the decaying airspeed, and that Asiana's policy discouraged manual flight.3
Away from aviation, the cleanest controlled evidence comes from navigation. In 2020 Louisa Dahmani and Véronique Bohbot tested 50 regular drivers on virtual navigation and rated their lifetime GPS use.4 Heavier GPS users had worse spatial memory when they had to find their way unaided. Thirteen came back three years later, and those who had used GPS more in the interim had declined more steeply.4 One detail speaks to the direction of cause. How good a navigator someone was at the start did not predict how much GPS they later used, which argues the tool drove the decline rather than weak navigators reaching for the crutch.4 The samples are small, so the effect size is uncertain, but the three-year arm is the before-and-after a deskilling claim rarely has.
For AI, the evidence is one colonoscopy study
Everything so far is about older automation. The question the argument is really being asked now is whether AI does the same thing, and here the measured evidence nearly runs out.
The single strongest study is about colonoscopies. Endoscopists are graded on their adenoma detection rate, the share of their colonoscopies in which they find at least one precancerous growth; a higher rate means fewer cancers missed. In a 2025 study from four Polish centers, researchers tracked that rate in ordinary colonoscopies done without AI, before and after the clinics began using an AI polyp-detection tool in their other cases.5 The 19 endoscopists were experienced, each with more than 2,000 colonoscopies behind them. Their unaided detection rate fell from 28.4% before the clinics adopted AI to 22.4% after, a drop of 6.0 percentage points, about a fifth of where they started (the confidence interval runs from 1.6 to 10.5 points).5
What makes this matter for deskilling, rather than for trusting the machine, is that it measured the doctors working without the AI: a change in what they did on their own. That is why it belongs here and not with automation bias, the separate failure of over-trusting a specific automated output in the moment.
Cautions come with it, which the study's own authors and outside reviewers press.56 The design is observational: the clinics were not randomly assigned, so something other than AI exposure could have moved the rate.7 There are only 19 endoscopists, with no breakdown showing whether the drop was broad or driven by a few, and no data on simpler explanations such as how long each doctor spent looking.6 The baseline rate was also low, around a quarter, against a US benchmark near 35%.6
So the drop is real and measured, but its cause is not settled. It could be the durable skill loss Bainbridge described, or short-term complacency that would lift when the stakes felt higher. A three-month dip shows behavior changed; it does not prove a capability was lost.6 One independent gastroenterologist warned of "the quiet erosion of fundamental skills" while noting AI's promise.7
The other AI-specific measurement people cite is weaker still. A 2025 MIT preprint had 54 people write essays over four months, some using a large language model, some a search engine, some no tools, and recorded their brain activity with EEG.8 The model users showed the weakest neural connectivity of the three groups and struggled most to quote back essays they had just written.8 But the paper is not peer reviewed, and a separate critique faults its sample size and EEG analysis.9 Weaker connectivity measures how engaged someone was, which can just mean less effort when help is on hand. It does not show that anyone's writing skill got worse.
Nobody has measured the coding-skill claim
The version repeated most often has the least behind it: that programmers who let an AI assistant write and debug their code will lose the ability to do it themselves, and miss the assistant's mistakes. It is a direct application of Bainbridge, and it is entirely a forecast. No controlled study measures erosion of programming or debugging skill from AI assistants.
The nearest relevant number cuts the opposite way. In 2025 METR ran a randomized trial with 16 experienced open-source developers on 246 tasks in their own repositories, some with AI tools allowed and some without.10 The developers expected AI to speed them up by about 24%, and afterward believed it had. It had in fact slowed them down by about 19%.10 That is a result about productivity, and about how badly people judge their own. It says nothing about whether their skills decayed; reading it as deskilling evidence would be a mistake.
Here confidence outruns proof in both directions. The people sure that AI is quietly hollowing out a generation of programmers have no measurement to point to. Neither do the people sure it is harmless. What can honestly be said is narrower: the mechanism is well understood, its effects are documented in older automation, and for AI the measurements have barely begun.
| Domain | What the evidence shows | How far it goes |
|---|---|---|
| Flight deck | Cognitive flying skills decayed; manual control mostly held. 16 pilots in a simulator.2 | Measured, controlled. |
| Airline accident | Automation reliance named as a contributor to a fatal monitoring failure.3 | Measured event, one case; not the probable cause. |
| Spatial memory | Heavier lifetime GPS use tracked worse unaided navigation, steeper over three years.4 | Measured, longitudinal, small sample. |
| Cancer detection | Unaided adenoma detection fell 28.4% to 22.4% after AI exposure.5 | Measured, but observational, 19 doctors, cause unsettled. |
| Essay writing | AI users showed the weakest EEG engagement while writing.8 | Proxy only, not peer reviewed, contested. |
| Debugging and coding | No study of skill loss; a trial found AI slowed developers while they believed it sped them up.10 | Not measured; a forecast. |
The takeaway
The argument is sound and it is old: take the routine part of a job away, and the skill for the hard part it leaves behind fades without practice. Where automation has had decades to work, that has been measured, though more precisely than the popular version says. The loss shows up first in judgment and attention, as much about disengagement as about lost muscle memory. For AI, the measured evidence amounts to a single observational study of colonoscopies and a contested preprint about essays, and the loudest claim of all, that AI is eroding programmers, has not been measured at all. So when you next hear that AI is deskilling us, the question is not whether the mechanism is real. It is. The question is whether anyone has measured it in the case being argued, and for most cases the honest answer is still no.
- 01
- Lisanne Bainbridge, "Ironies of Automation" (1983): the five-page paper that started the argument.
- 02
- METR, measuring AI's effect on experienced developers (2025): the randomized trial on speed and self-perception.
Sources
- Automatica · Lisanne Bainbridge, "Ironies of Automation" (1983)
- Human Factors · Casner, Geven, Recker & Schooler, manual-flying-skill retention study (2014)
- NTSB · Accident Report AAR-14/01, Asiana Airlines Flight 214 (2014)
- Scientific Reports · Dahmani & Bohbot, GPS use and spatial memory (2020)
- The Lancet Gastroenterology & Hepatology · Budzyn et al., AI exposure and unaided colonoscopy performance (2025)
- American College of Gastroenterology · Zhou, Evidence-Based GI review of the AI-exposure study (2025)
- EurekAlert! · Lancet Gastroenterology & Hepatology press release on the colonoscopy study (2025)
- arXiv · Kosmyna et al., essay-writing EEG preprint (2025)
- arXiv · Stankovic et al., critique of Kosmyna et al. (2025)
- METR · Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity (2025)