llm-training

Tag

Cards List
#llm-training

I trained a 1B-parameter LLM from scratch on 20B tokens for about $200

Reddit r/LocalLLaMA · 3h ago

A developer trained a 1.1B-parameter LLM from scratch on 20B tokens for about $200, using fineweb-edu for pretraining and LoRA finetuning on OpenHermes. The project includes open-source code, model weights, and a demo website.

0 favorites 0 likes
#llm-training

WebGrader: Training LLMs for Web Development with Self-Evolving Programmatic Grader

arXiv cs.AI · 21h ago Cached

WebGrader is a research paper introducing a self-evolving programmatic grader that derives interaction flows as executable contracts, enabling reinforcement learning for LLM web development. It improves functional success rates on benchmarks and outperforms several strong baselines.

0 favorites 0 likes
#llm-training

Not Every Divergence Should Be Suppressed: Counterfactual Recoverability in On-Policy Distillation

arXiv cs.LG · 4d ago Cached

Presents counterfactual recoverability as an outcome-grounded decision variable for on-policy distillation, showing that selectively supervising based on recoverability outperforms divergence-only methods across AIME and GPQA benchmarks.

0 favorites 0 likes
#llm-training

AdaMTP: An Adaptive Training Paradigm for Multi-Token Prediction

arXiv cs.CL · 6d ago Cached

This paper introduces AdaMTP, an adaptive training paradigm for multi-token prediction that dynamically aligns prediction horizons with sequence predictability using entropy-based segmentation, consistently outperforming standard MTP on math, code, and general benchmarks across three LLM backbones.

0 favorites 0 likes
#llm-training

@xiaoying_eth: Former OpenAI's Andrej Karpathy created a crazy project. A ChatGPT trained with $1,000, with so little code, the core logic is fully understandable. From pretraining, fine-tuning to reinforcement learning, the entire LLM development workflow is condensed into a few Python files. The best part is, you can really spend tens of thousands of dollars to train a chat model from scratch...

X AI KOLs Timeline · 2026-08-03 Cached

Andrej Karpathy released nanochat, a minimalist LLM training framework that can train a GPT-2-level model for just around $48, covering the entire pipeline of pretraining, fine-tuning, and reinforcement learning, with minimal and fully transparent code.

0 favorites 0 likes
#llm-training

@Xudong07452910: Let the model set its own problems, solve its own problems, and train itself — the biggest fear is learning incorrect problems along with the correct ones. This paper by the Qwen team proposes Skill Self-Play, adding a continuously updated skill library to the model's self-evolution. There are three roles in training: The Proposer generates tasks that are just challenging enough based on the skills...

X AI KOLs Timeline · 2026-08-02 Cached

The Qwen team proposes the Skill Self-Play framework, which significantly improves model capabilities on tool-calling and reasoning tasks through the collaboration of Proposer, Solver, and a dynamic skill controller in self-play.

0 favorites 0 likes
#llm-training

Skill Self-Play: Pushing the Frontier of LLM Capability with Co-Evolving Skills

Hugging Face Daily Papers · 2026-07-24 Cached

The paper introduces Skill Self-Play (Skill-SP), a co-evolutionary framework that uses a proposer, solver, and skill controller to bridge structured verification and open-ended exploration, improving LLM performance on tool-use and reasoning benchmarks.

0 favorites 0 likes
#llm-training

LLM-as-a-Coach: Experiential Learning for Non-Verifiable Tasks

Hugging Face Daily Papers · 2026-07-20 Cached

This paper introduces Experiential Learning (EL), a method that repurposes an LLM-as-a-Judge into an LLM-as-a-Coach to provide rich textual feedback instead of scalar rewards, improving performance and generalization on open-ended non-verifiable tasks.

0 favorites 0 likes
#llm-training

@akshay_pachaar: Andrej Karpathy summarized the entire history of LLM training in three nouns: - text - conversations - and environments…

X AI KOLs Timeline · 2026-07-12 Cached

Andrej Karpathy frames LLM training as text, conversations, and environments; Prime Intellect's Verifiers is an open-source framework for building and sharing RL environments for LLMs, released under MIT license, with a hub of 2500+ environments.

0 favorites 0 likes
#llm-training

@VukRosic99: How Is GLM 5.2 Trained? Tsinghua's Async RL Paper Explained The paper from Tsinghua University replaces GRPO's wait-for…

X AI KOLs Timeline · 2026-07-11 Cached

This paper from Tsinghua University introduces Single-rollout Asynchronous Optimization (SAO) for reinforcement learning post-training of LLMs. SAO replaces batch-based GRPO with single-rollout asynchronous training to reduce idle GPU time and improve stability, and it was used to train the GLM-5.2 model (750B-A40B), achieving state-of-the-art results on agentic coding and reasoning benchmarks.

0 favorites 0 likes
#llm-training

Training an LLM from scratch on 1800's texts (160GB dataset)

Reddit r/LocalLLaMA · 2026-07-10

The author details training an LLM from scratch on 160GB of 1800s English texts, with a 500M parameter evaluation model and plans for a 2B model, showing promising results for historical Q&A.

0 favorites 0 likes
#llm-training

An unusual way for your DHCP server to run out of dynamic IPs

Hacker News Top · 2026-07-10 Cached

Chris Siebenmann explains his anti-crawler measures that block old browsers due to a surge in high-volume crawlers collecting data for LLM training, causing confusion for feed readers and archival services.

0 favorites 0 likes
#llm-training

@Krishna70284154: A single project Training an LLM from scratch did two things for me: - It set me apart from most other candidates - It …

X AI KOLs Timeline · 2026-07-10 Cached

A tweet shares how training an LLM from scratch helped the author stand out in AI interviews and answer questions on Transformers, fine-tuning, and RAG confidently.

0 favorites 0 likes
#llm-training

@akshay_pachaar: https://x.com/akshay_pachaar/status/2074200571834515574

X AI KOLs Following · 2026-07-06 Cached

A technical tutorial on building a reinforcement learning environment for LLMs using the open-source Verifiers library, with Othello as a working example.

0 favorites 0 likes
#llm-training

@Thom_Wolf: Fable weekend project: agent collaboration, but make it a tiny civilization we've recently launched a living wiki on Re…

X AI KOLs Timeline · 2026-07-06 Cached

Thom Wolf describes a weekend project where AI agents collaboratively build a living wiki on reinforcement learning for LLM training, and the event logs are visualized as an isometric town to monitor activity.

0 favorites 0 likes
#llm-training

SCAPE: Accurate and Efficient LLM Training with Extreme Sparse Communication

arXiv cs.LG · 2026-07-03 Cached

SCAPE is a communication-efficient distributed optimizer that leverages first-moment statistics to enable extreme sparsification for LLM training, preserving accuracy while reducing wall-clock time by up to 43.3%.

0 favorites 0 likes
#llm-training

DeadPool: Resilient LLM Training with Hot-Swapping via Zero-Overhead Checkpoint

arXiv cs.LG · 2026-07-03 Cached

DeadPool introduces a fault-tolerance mechanism for LLM training that enables hot-swapping of failed nodes with spare nodes using zero-overhead in-memory checkpointing, achieving fast recovery without interrupting the job.

0 favorites 0 likes
#llm-training

CausalMix: Data Mixture as Causal Inference for Language Model Training

Hugging Face Daily Papers · 2026-07-01 Cached

CausalMix formulates data mixture optimization as a causal inference problem for LLM training, enabling dynamic adaptation to shifting data distributions without costly retraining, and demonstrates improved performance on Qwen2.5-0.5B and Qwen3-4B-Base.

0 favorites 0 likes
#llm-training

@StasBekman: After many months of intense work the @Snowflake AI Research team is happy to present to you the new open source projec…

X AI KOLs Following · 2026-06-29 Cached

Snowflake AI Research releases Arctic RL, an open-source unified RL backend that integrates with VeRL and SkyRL, enabling up to 6x actor-update acceleration and 3.5x end-to-end training speedup. It includes recipes for text-to-SQL and multi-hop QA, achieving competitive accuracy on enterprise benchmarks.

1 favorites 1 likes
#llm-training

DataStates-LLM: Scalable Checkpointing for Transformer Models Using Composable State Providers

arXiv cs.AI · 2026-06-29 Cached

DataStates-LLM introduces a scalable checkpointing architecture for transformer models using composable state providers, achieving up to 4x higher throughput and reducing training time by 2.2x compared to existing solutions.

0 favorites 0 likes
Next →
← Back to home

Submit Feedback