Paul Le
0 followers · 230 views
on the atlas · 5
- Harness Engineering for Self-Improvement | Lil'Log19 savers
- N-body problem1 savers
- Molecular Notes: Principles · Reasonable Deviations1 savers
- Dimensional analysis2 savers
- Humanity's Last Machine26 savers
highlights · 6
Harness engineering will evolve in the direction of meta-methodology (i.e. improving the machinery for getting better answers, not just improving the answer itself).
Harness Engineering for Self-Improvement | Lil'LogIt is no longer only prompt templates, but closer to runtime and software system design: how the model observes, acts, memorizes, checks itself, and improves.
Harness Engineering for Self-Improvement | Lil'LogA harness is the system surrounding a base model that orchestrates execution and decides how the model thinks and plans, calls tools and acts, perceives and manages context, stores artifacts, and evaluates results.
Harness Engineering for Self-Improvement | Lil'Logthe layer between the raw model and the real-world context seems to be as important as the model’s raw intelligence (i.e. the evals right after pretraining)
Harness Engineering for Self-Improvement | Lil'Logthe model improves the training pipeline and the deployment system, which in turn enables a better successor model with improved performance across economically valuable tasks
Harness Engineering for Self-Improvement | Lil'LogAny physically meaningful equation or inequality must have the same dimensions on its left and right sides, a property known as dimensional homogeneity
Dimensional analysis