AI product Open source
Marin is an open-source research program, software platform, and community for developing foundation models, with a focus on large language models. It covers data curation, transformation and filtering, tokenization, pretraining, posttraining, and evaluation, while recording processes, experiments, decisions, artifacts, and failed experiments from raw data through final model. Marin experiments are defined as dependent steps executed in topological order, similar to a Makefile, and the platform can scale from small language-model runs to large TPU deployments. The project has also been used for audio-text, DNA, and protein models and provides documentation, experiment code, checkpoints, and reusable training pipelines.
1 use taken from transcripts — each links to the moment in the video.
An open-source framework for reproducible foundation-model research, covering data curation, filtering, tokenization, training, and evaluation. It records each step, including failed experiments, and scales from CPU models to large TPU deployments.
1 in the library.