Kalai et al. (OpenAI, Georgia Tech) · OpenAI · openai.com
Argues models make things up partly because training and test scoring reward a confident guess over saying 'I don't know', and suggests scoring that penalises confident errors.
Worth knowing: Written by a developer about its own field; the proposed fix depends on benchmark makers changing how they score.
Samuel R. Bowman · arXiv · arxiv.org
A short, readable list of surprising facts about LLMs: new abilities emerge unpredictably, no technique reliably steers them, and experts cannot yet explain how they work inside.
Worth knowing: Author is affiliated with New York University and Anthropic.
Research paperMar 4, 2022Technical
Long Ouyang, Jeff Wu, Xu Jiang et al. (OpenAI) · arXiv · arxiv.org
OpenAI paper on fine-tuning GPT-3 with human-written examples and human rankings of its answers (RLHF); people preferred the resulting small model over the original one more than 100 times larger.
Research paperJun 12, 2017Technical
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin · arXiv · arxiv.org
The research paper that introduced the transformer, a neural-network design built around 'attention' that became the basis of today's large language models.