Ofir Press
ofir.io · 1,237 words · saved by 1 readers
My thoughts on deep learning for NLP
Ofir Press How to Build Good Language Modeling Benchmarks Building benchmarks is important because they shine a spotlight on the weaknesses of existing language models and so can guide the community on how to improve them. Read More 5 Tips for Finding Research Topics I’ve spent the past eight years doing research on neural language models. While my top-level goal of making language models more useful to humans has remained stable, my path to achieving it has changed over time. I’ve learned that in research, you not only have to learn how to execute on a given idea, but you also have to learn h
saved by
related reading
- machine learning imindslice.substack.com
- DeepSeek-R1arxiv.org
- Language Models will be Scaffoldsalexzhang13.github.io
- [2005.14165] Language Models are Few-Shot Learnersarxiv.org
- Getting Caught Up to Modern LLM Research | Samarth Goeldev.samarthgoel.com
- Language Models, World Models, and Human Model-Buildinglingo.csail.mit.edu
- Language Modelinglena-voita.github.io
- GenAI Handbookgenai-handbook.github.io
- A History of Large Language Modelsgregorygundersen.com
- Alex L. Zhangalexzhang13.github.io
- Language models can explain neurons in language modelsopenaipublic.blob.core.windows.net
- Stanford CS336 | Language Modeling from Scratchcs336.stanford.edu