Carbon-X is an open 14.8B model trained jointly on DNA and text [R]

Reddit r/MachineLearning Models

Summary

Carbon-X is an open 14.8B decoder-only model that jointly processes raw DNA and text via a shared 6-mer token stream, achieving 66.7% average on five DNA benchmarks — nearly matching GPT-6.1 Sol — with Apache 2.0 weights that fit on a single 80GB GPU.

Carbon-X is a 14.8B parameter decoder-only model that takes raw DNA in a normal chat and answers in English. It shares one token stream for text and DNA, using 6-mer tokens, and was mid-trained on 302B tokens. Hugging Face reports a 66.7% average across five DNA benchmarks with thinking disabled, versus 67.5% for GPT-6.1 Sol. The weights fit on one 80 GB GPU in bfloat16 and are Apache 2.0. It has not been clinically validated, and the model card says exact sequence operations should still be handled by code. the useful part is making sequence analysis local enough for sensitive datasets. has anyone tested whether the benchmark gains hold on private variant datasets? source: https://huggingface.co/HuggingFaceBio/Carbon-X
Original Article

Similar Articles

Carbon: Decoding the Language of Life

Reddit r/LocalLLaMA

Hugging Face released Carbon, a family of open DNA foundation models that matches state-of-the-art performance of Evo2-7B while being 275x faster, using 6-mer tokenization, factorized loss, and curated genomic data.

@aisolopreneur: Hugging Face just released Carbon-X, an open model you can ask questions about DNA in plain English, and on its own tes…

X AI KOLs Timeline

Hugging Face released Carbon-X, an open DNA language model that answers questions about gene sequences in plain English, scoring 66.7% on DNA benchmarks near GPT-6.1 Sol at roughly 1/1,800 the cost per problem. It runs on a single 80GB GPU, potentially making large-scale variant classification dramatically cheaper for hospitals and researchers, though it is not yet clinically validated.