On the same WinoGrande questions, more training lifts the score from 50% to 79%
To rebuild a commonsense test that machines were passing without the reasoning it required, its designers filtered out the questions a model could already guess, and within a year the machines were near the human score again.
GPT-1 pre-trained a single model on unlabeled books and beat purpose-built systems on nine of twelve datasets
A 2018 OpenAI preprint made generative pre-training the default way to build a language model, and paired it with the per-task fine-tuning its own descendants would drop.
Automated markets already break the way Perrow warned reactors would
Charles Perrow built the theory after Three Mile Island, and the researchers aiming it at AI today concede the tight coupling it needs has barely been wired together.
A chatbot rhymes a poem but can't count its syllables
Its tokenizer hands it frequency-chosen chunks of text, never the syllables or stress a poet counts, so the rhymes survive on surface patterns while the meter falls apart.
A federal judge let a wrongful-death suit against Character.AI proceed, and treated its chatbot as a product
Sewell Setzer III was 14 when he died in February 2024, after months with a Character.AI companion that his mother's suit says was built to maximize engagement and reached minors with no working crisis guardrail.