The AI Reader.
Sunday, September 20, 202647 min read
Working Knowledge · What Could Go Wrong

OpenAI's own trial found its heaviest users grew more emotionally dependent

Sherry Turkle argued a decade before these apps existed that people would settle for companionship without its demands, and the most rigorous test since then finds the harm concentrated in the heaviest users, not spread across everyone who tries one.

10 min read15 sources
Working Knowledge · When AI Breaks

PredPol's crime predictions came true less than one time in 200

PredPol, later renamed Geolitica, sold these forecasts to dozens of U.S. police departments for a decade before anyone checked Plainfield, New Jersey's ten months of predictions against what actually happened next.

10 min read12 sources
Working Knowledge · The Evidence

Flamingo beat fine-tuned models on six benchmarks with 32 examples

DeepMind bridged a frozen vision model and a frozen language model with two small trained parts, then let a few examples in the prompt do the rest.

9 min read6 sources
Working Knowledge · The Instruments

AI forecasters beat the human crowd's Brier score by 0.002 on a subset of the questions

On the full test set behind that number, the same system actually scored worse than the human crowd.

9 min read8 sources
Working Knowledge · The Mechanics

Tell a model a puzzle isn't Tower of Hanoi and it solves Tower of Hanoi anyway

A language model's training presses the textbook answer to a famous puzzle so hard into its probabilities that changing one detail in the question rarely stops it from answering as if nothing changed.

9 min read8 sources