The AI Reader.
Friday, September 18, 202646 min read
Working Knowledge · The Instruments

YOLOv3 tied RetinaNet on one mAP and trailed it by 4.8 points on another

COCO's headline detection score averages the overlap test across ten thresholds where PASCAL VOC used a single one, which is why the same two detectors, YOLOv3 and RetinaNet, tied under one and split by 4.8 points under the other.

10 min read9 sources
Working Knowledge · The Mechanics

A typo still breaks into pieces the model has already learned

Subword tokenizers split a misspelling into fragments that already carried meaning from training, and the same flexibility gives a deliberate attacker a way in.

10 min read11 sources
Working Knowledge · The Evidence

The 2016 WaveNet paper never reports its own generation speed

Van den Oord and DeepMind's 2016 model scored 4.21 out of 5 in its own listening test, against a natural recording that scored 4.55 in the same test.

9 min read8 sources
Working Knowledge · What Could Go Wrong

Carlsmith multiplied six probabilities into a 5% chance of catastrophe. He later raised it past 10%.

His 2021 report chains six premises about power-seeking AI into one multiplied probability, and reviewers split three ways over the arithmetic.

9 min read9 sources
Working Knowledge · When AI Breaks

Five of Sports Illustrated's product reviewers were AI-generated people

AdVon Commerce, the vendor that supplied the reviews, gave each byline a stock AI headshot and an invented biography.

8 min read11 sources