Research paperMar 4, 2022Technical
Long Ouyang, Jeff Wu, Xu Jiang et al. (OpenAI) · arXiv · arxiv.org
OpenAI paper on fine-tuning GPT-3 with human-written examples and human rankings of its answers (RLHF); people preferred the resulting small model over the original one more than 100 times larger.
Research paperJun 12, 2017Technical
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin · arXiv · arxiv.org
The research paper that introduced the transformer, a neural-network design built around 'attention' that became the basis of today's large language models.