Jane Street Blog - A study of sequence weighting at scale
blog.janestreet.com · saved by 1 readers
TL;DR: We study the scaling laws of data weighting across in-house and open-weight LMs, finding non-monotonic behavior across scales. We vary the weight assi...