FineDNA releases dataset and materials to train LLMs on DNA, including midtraining data, SFT conversations, and RL prompts
Read the original at www.reddit.com→Hi everyone, we're releasing FineDNA, all the data we used to turn Qwen3-14B into Carbon-X, the strongest open language model on DNA. It contains: Midtraining: 300B+ tokens of genomes and DNA-rich text SFT: ~200K...
Original headline: "FineDNA: the largest dataset to teach any LLM DNA (midtraining, SFT, RL)"
Coverage timeline
- Nov 1, 07:24 UTC r/LocalLLaMA lead source FineDNA: the largest dataset to teach any LLM DNA (midtraining, SFT, RL)