Pretraining data filtering in open-weight biological models | AISI Work
aisi.gov.uk · saved by 1 readers
We assess the strength of pretraining data filtering as a safeguard for open-weight protein models, and find it to be effective and selective, but not necessarily durable against fine-tuning.