Naomi Saphra

nsaphra.net · 550 words · saved by 2 readers

I am a research fellow at the Kempner Institute at Harvard University. I am interested in NLP training dynamics: how models learn to encode linguistic patterns or other structure and how we can encode useful inductive biases into the training process. Previously, I earned a PhD from the University of Edinburgh on Training Dynamics of Neural Language Models; worked at NYU, Google and Facebook; and attended Johns Hopkins and Carnegie Mellon University. Outside of research, I play roller derby under the name Gaussian Retribution, perform standup comedy, and shepherd disabled programmers into the world of code dictation. PhD in Informatics, 2021 University of Edinburgh MEng in Computer Science, 2015 Johns Hopkins University BSc in Computer Science, 2013 Carnegie Mellon University Most interpretability research in NLP focuses on understanding the behavior and features of a fully trained model. However, certain insights into model behavior may only be accessible by observing the trajectory o

Naomi Saphra Assistant Professor About Me I am an Assistant Professor in Boston University’s faculty of Computing & Data Sciences interested in language model training mechanics: how models learn to encode linguistic patterns or other structure and how we can encode useful inductive biases into the training process. I also work broadly on interpretability and robust generalization. Previously, I earned a PhD from the University of Edinburgh on Training Dynamics of Neural Language Models, was a postdoc at NYU, and was a Kempner Research Fellow at Harvard. My work has been profiled in…

Naomi Saphra

saved by

related reading