flâneur — a map of the web's best reading

GPT-4 gets a B on my quantum computing final exam! — Shtetl-Optimized

scottaaronson.blog · 37,227 words · saved by 1 readers

Update (April 14): On the suggestion of my TA Justin Yirka, I gave GPT-4 problem 2 from the final exam, along with its own answers and my and Justin’s grading comments, and asked it whether it wanted to argue for a higher grade, and if so on what basis. Here is what it wrote (it felt disconcerting to see the grade-grubbing appear immediately, with not even one second’s delay): I would like to argue for a higher grade on the following subproblems: (a) I agree that my initial answer for the density matrix of the entire state was incorrect. However, I believe that my approach to the problem was correct, and I demonstrated knowledge of the necessary steps to calculate the reduced density matrix. I would like to request an additional point for demonstrating the correct approach, making it 2 points out of 5. (b) My answer for the entanglement entropy was partially correct, as I calculated the eigenvalues of the reduced density matrix and plugged them into the correct entropy formula. However

Shtetl-Optimized >> Blog Archive >> GPT-4 gets a B on my quantum computing final exam! Shtetl-Optimized The Blog of Scott Aaronson If you take nothing else from this blog: quantum computers won't solve hard problems instantly by just trying all solutions in parallel. Also, please read Zvi Mowshowitz's masterpiece on how to fix K-12 education! --> << Quips are what I’ve got AI safety: what should actually be done now? >> GPT-4 gets a B on my quantum computing final exam! Update (April 14): On the suggestion of my TA Justin Yirka, I gave GPT-4 problem 2 from the final exam, along with its own an

Explore this link on the map →

related reading