Relative Scaling Laws for LLMs | OpenReview
openreview.net · 265 words · saved by 1 readers
Scaling laws describe how language models improve with additional data, parameters, and compute. While widely used, they are typically measured on aggregate test sets. Aggregate evaluations yield...