Evaluating the role of pretraining dataset size and diversity on single-cell foundation model performance | Nature Methods
The performance of single-cell foundation models is dependent on many factors. This study assesses the effect of the pretraining dataset’s size and diversity, revealing potential challenges in pursuing consistent improvement by naively scaling up pretraining data.
Lopez, R., Regier, J., Cole, M. B., Jordan, M. I. & Yosef, N. Deep generative modeling for single-cell transcriptomics. Nat. Methods 15, 1053–1058 (2018). Article CAS PubMed PubMed Central Google Scholar Demetci, P., Santorella, R., Sandstede, B., Noble, W. S. & Singh, R. Scot: single-cell multi-omics alignment with optimal transport. J. Comput. Biol. 29, 3–18 (2022). Article CAS PubMed PubMed Central Google Scholar van Dijk, D. et al. Recovering gene interactions from single-cell data using data diffusion. Cell 174, 716–729 (2018). Google Scholar Lotfollahi, M., Wolf, F. A. & Theis,…
saved by
related reading
- Accurate predictions on small data with a tabular foundation modelnature.com
- scGPT: toward building a foundation model for single-cell multi-omics using generative AI | Nature Methodsnature.com
- Generalist - GEN-0 / Embodied Foundation Models That Scale with Physical Interactiongeneralistai.com
- scGen predicts single-cell perturbation responsesnature.com
- Quantifying the effect of experimental perturbations at single-cell resolutionnature.com
- frontier model training methodologies | Alex Wa's Blogdjdumpling.github.io
- Deep-learning-based gene perturbation effect prediction does not yet outperform simple linear baselinesnature.com
- [2005.14165] Language Models are Few-Shot Learnersarxiv.org
- On the Opportunities and Risks of Foundation Modelsarxiv.org
- MAI-Thinking-1: Building a Hill-Climbing Machinemicrosoft.ai
- PREDICTING SINGLE-CELL PERTURBATION RESPONSES FOR UNSEEN DRUGSarxiv.org
- Tahoe 100M: The World's Largest Single-Cell Dataset, Open-Sourced as the Inaugural Contribution to Arc Institute's New Virtual Cell Atlas | Tahoetahoebio.ai