FlashAttention does more arithmetic to move less data
Dao and coauthors' 2022 paper tiles the score matrix through a GPU's on-chip memory, cutting one training configuration's HBM traffic from 40.3GB to 4.4GB and its runtime from 41.7 to 7.3 milliseconds.
Millions of watermarked stock photos teach image generators to draw one of their own
A diffusion model learns the regularities across billions of training photos, and a stock-photo mark common enough in that data becomes one of them, a mechanism distinct from the rarer case where a model reproduces one training photo almost whole.
AI's outcome worse than extinction borrows its scale math from an essay that never mentions suffering
Researchers studying AI's worst-case suffering risk reuse Nick Bostrom's 2003 math for the cost of delayed space colonization to argue a fast-moving optimizer might accept suffering as the price of speed.
A mean opinion score doesn't travel between tests
The same three synthetic voices from a 2013 listening test scored a full point lower on a five-point scale when researchers replayed the identical recordings eight years later next to newer systems, though the ranking between them never moved.
Facebook delivered identically targeted job ads to audiences 90% male and 85% female
Facebook’s own delivery system produced the skew, invisible to the advertisers until a controlled study isolated it.