Marin
Marin is an open lab for building foundation models—together. We’re training powerful models from scratch, and sharing and programmatically documenting every step: the code, the data, the experiments, the mistakes…all in real-time. We invite anyone who shares our vision of open science and open-source to join and contribute, whether you want to try out a new architecture, training algorithm, dataset, evaluation…there is a lot to do! To learn more about the vision, read our launch announcement. Want to jump in? Install the Marin code and run your first experiment! Want to stay up to date? Join our Discord or our mailing list. Building a foundation model requires countless experiments trying out endless variants of algorithms and datasets. All the experiments we’re doing are captured as GitHub issues (here is a summary). Here’s the lifecycle of an experiment: Some examples: We trained some models in Marin: Have a new architecture or training procedure that you think is more efficient? Pa
Explore this link on the map →