scGPT: toward building a foundation model for single-cell multi-omics using generative AI | Nature Methods
Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript. Advertisement Nature Methods (2024)Cite this article 10k Accesses 91 Altmetric Metrics details Generative pretrained models have achieved remarkable success in various domains such as language and computer vision. Specifically, the combination of large-scale diverse datasets and pretrained transformers has emerged as a promising approach for developing foundation models. Drawing parallels between language and cellular biology (in which texts comprise words; similarly, cells are defined by genes), our study probes the applicability of foundation models to advance cellular biology and genetic research. Using burgeoning singl
Subjects Computational models Machine learning Software Transcriptomics Abstract Generative pretrained models have achieved remarkable success in various domains such as language and computer vision. Specifically, the combination of large-scale diverse datasets and pretrained transformers has emerged as a promising approach for developing foundation models. Drawing parallels between language and cellular biology (in which texts comprise words; similarly, cells are defined by genes), our study probes the applicability of foundation models to advance cellular biology and genetic research. Using
related reading
- Evaluating the role of pretraining dataset size and diversity on single-cell foundation model performancenature.com
- Let's build GPT: from scratch, in code, spelled out.youtube.com
- GPT in 60 Lines of NumPy | Jay Modyjaykmody.com
- scGen predicts single-cell perturbation responsesnature.com
- On the Opportunities and Risks of Foundation Modelsarxiv.org
- microgptkarpathy.github.io
- Import AIjack-clark.net
- Let's reproduce GPT-2 (124M)youtube.com
- Google’s Gemma AI model helps discover new potential cancer therapy pathwayblog.google
- Generative AI: A New Generation of AI - by Josh Houjoshhou.substack.com
- Deep-learning-based gene perturbation effect prediction does not yet outperform simple linear baselinesnature.com
- A Primer on Generative AI (GenAI) - by Arun Raohashcollision.substack.com