TOPIC
3 Stories Published
Transformers
A.I.
9m
Why Transformers Stop Following References Early, and How a Rank-8 LoRA at One Layer Pushes Them Further
A September 29 arXiv paper reports that pretrained transformers follow only a few in-context references, and that a tiny LoRA at one…
A.I.
10m
A Short History of Artificial Intelligence: Turing to Transformers
From Turing's 1950 paper through Dartmouth, two AI winters, AlexNet and the 2017 transformer, with the caveats historians raise.
A.I.
10m
How Large Language Models Like ChatGPT Actually Work
A plain-language tour of tokens, attention, pretraining and human feedback, plus what researchers still argue about.