Friday, September 11, 202646 min read
Working Knowledge · The Mechanics
A coding assistant invents the same fake package run after run
Because the same invented name recurs, an attacker can register it first, so a developer who pastes the assistant's import installs code the attacker wrote.
Working Knowledge · When AI Breaks
ChatGPT accused Mark Walters of embezzling millions from a group he never worked for
The only such lawsuit to reach a ruling cleared OpenAI on grounds so specific to Walters that the larger question of who is liable remains untested.
Working Knowledge · The Evidence
Stable Diffusion does its denoising on a compressed grid, not the full image
Robin Rombach's CompVis team published the method behind Stable Diffusion in 2022, the design its successors were built on.
Working Knowledge · What Could Go Wrong
Researchers pulled private data out of four shipping AI agents with hidden text
Simon Willison calls the three-permission combination behind these attacks the lethal trifecta and argues no detector will ever reliably stop it.
Working Knowledge · The Instruments
Barratt and Sharma drove the Inception Score to 900 of 1000 with one image per class
The Inception Score grades a generator by passing its pictures through a frozen ImageNet classifier, never once comparing them to a real photograph.