Ofir Press
ofir.io · 1,237 words · saved by 1 readers
My thoughts on deep learning for NLP
Ofir Press How to Build Good Language Modeling Benchmarks Building benchmarks is important because they shine a spotlight on the weaknesses of existing language models and so can guide the community on how to improve them. Read More 5 Tips for Finding Research Topics I’ve spent the past eight years doing research on neural language models. While my top-level goal of making language models more useful to humans has remained stable, my path to achieving it has changed over time. I’ve learned that in research, you not only have to learn how to execute on a given idea, but you also have to learn h
saved by
related reading
- An Opinionated Guide to ML Researchjoschu.net
- Tips for Empirical Alignment Research — AI Alignment Forumalignmentforum.org
- machine learning imindslice.substack.com
- A Survival Guide to a PhDkarpathy.github.io
- blog/2024.09.impact.md at main · okhat/blog · GitHubgithub.com
- Getting Caught Up to Modern LLM Research | Samarth Goeldev.samarthgoel.com
- Illustrating Reinforcement Learning from Human Feedback (RLHF)huggingface.co
- LLM Resourcesforrestbicker.com
- Is a PhD on Language Models Worth it in 2025?ruiqizhong.substack.com
- Large Language Models Reading List | Sebastian Raschka, PhDsebastianraschka.com
- machine learning i - by vincent huang - a slice of my mindsubstack.com
- A History of Large Language Modelsgregorygundersen.com