Babylon sold an AI as good as a doctor, and its chatbot read a heart attack as a panic attack
The score came from a hundred scripted cases, graded by a single judge, on the conditions Babylon's own system was already built to recognize.
ELMo set records on six language tasks without replacing the models it improved
The Allen Institute made a word's vector depend on its whole sentence, with a method BERT discarded within a year.
An MLPerf number is comparable only to another in its box
Double the chip count from 256 to 512 and the same Llama 3.1 405B run goes 1.93 times as fast, a fact about how many chips you bought and not about a better one.
A chatbot can't keep a word it never wrote down
Its answers to a run of guesses stop agreeing because a plain chat stores nothing between turns, so the word it promised to keep was never written anywhere and does not exist.
The viral AI-footprint numbers all describe one query or one run, and that is the wrong scale
Both the five-car carbon stat and the ten-times-a-search query were revised down by 88-fold and tenfold, while the number that actually strains grids, 415 terawatt-hours of data-centre power in 2024, draws the least argument.