training-infrastructure

Tag

Cards List
#training-infrastructure

@ClementDelangue: We turned Claude Code, Codex, Hermes, Pi, @opencode and other coding harnesses into RL environments. No changes to the …

X AI KOLs Timeline ↗ · 2026-10-05 Cached

Hugging Face turned real coding agent harnesses like Claude Code, Codex, Hermes, Pi, and OpenCode into RL training environments via a capture proxy, requiring no changes to the harnesses or training code, with all models, tasks, data, and code fully open sourced.

0 favorites 0 likes
#training-infrastructure

Olmo-core 3 for MoE Training (8 minute read)

TLDR AI ↗ · 2026-10-02 Cached

Ai2 发布 Olmo-core 3,一款面向大规模 MoE 训练的开源框架升级,采用 DDP-based 路由设计与多种并行技术,可在保持约 3.2B 激活参数的情况下将总参数扩展至万亿级别,吞吐量较旧实现提升约 2.7 倍。

0 favorites 0 likes
#training-infrastructure

Introducing Olmo-core 3: Open, scalable training infrastructure for large MoEs

Hugging Face Blog ↗ · 2026-10-01 Cached

AllenAI released Olmo-core 3, an open, scalable training framework redesigned for large mixture-of-experts LLMs, benchmarked at over one trillion total parameters with minimal throughput loss as the expert pool grows.

0 favorites 0 likes
#training-infrastructure

MiMo-V2.6: Scaling Reinforcement Learning Towards Self-Improvement (9 minute read)

TLDR AI ↗ · 2026-09-22 Cached

MiMo-V2.6 introduces Groupwise Advantage Redistribution to enhance reinforcement learning for AI agents by comparing sibling attempts and using graded feedback, showing steady performance improvements across multiple task domains.

0 favorites 0 likes
#training-infrastructure

@seclink: 强 ... https://dyna.co/research/dyna-2-infrastructure… https://dyna.co/dyna-2

X AI KOLs Timeline ↗ · 2026-08-19 Cached

The article details the infrastructure and challenges in training the Dyna-2 AI model at a million-hour scale, focusing on data lifecycle and GPU cluster optimizations.

0 favorites 0 likes
#training-infrastructure

@KaichaoYou: Scaling concurrent rollouts is one of the hardest parts of RL training infra. We had fun helping SemiAnalysis stress-te…

X AI KOLs Timeline ↗ · 2026-06-17 Cached

KaichouYou discusses challenges in scaling concurrent rollouts for RL training infrastructure, highlighting a stress test of sandbox scaling on Qwen3 235B with SemiAnalysis, including a writeup of errors and fixes.

0 favorites 0 likes
#training-infrastructure

@modal: Sandbox startup latency and scaling can make or break your RL training run. Great post breaking this down, shown using …

X AI KOLs Following ↗ · 2026-06-16 Cached

Discusses how sandbox startup latency and scaling in RL training infrastructure can significantly impact training performance, referencing a detailed analysis by SemiAnalysis on matching trainer and generator throughput.

0 favorites 0 likes
#training-infrastructure

Entry-level work is also training infrastructure. I think AI adoption needs to account for that.

Reddit r/AI_Agents ↗ · 2026-06-12

The article argues that entry-level work serves as training infrastructure for developing judgment and skills, and that AI adoption must account for this apprenticeship function to avoid weakening the path to senior expertise.

0 favorites 0 likes
#training-infrastructure

@xinyzng: It's interesting to see @MicrosoftAI uses ray actors not just for controller and rollout workers but problem workers fo…

X AI KOLs Following ↗ · 2026-06-03

The tweet discusses Microsoft AI's use of Ray actors for training the MAI-Thinking-1 model, enabling finer granularity for heterogeneous compute and better CPU resource utilization in GPU clusters.

0 favorites 0 likes
← Back to home

Submit Feedback