@modal: And we added first-class support for post-training Beam yourself. Get started with Modal Dojo now: https://dojo.modal.d…
Summary
Modal announced first-class support for post-training Reflection's Beam model and released Modal Dojo, an open-source library and skill bundle for production-grade LLM training (including RL) on Modal, with an example training Qwen3.5-4B on GSM8K.
View Cached Full Text
Cached at: 11/01/26, 05:56 PM
And we added first-class support for post-training Beam yourself.
Get started with Modal Dojo now: https://t.co/Pd4NOcRWlG
Modal Dojo
Source: https://dojo.modal.dev/ Modal Dojo is an open-source library to get started with production-grade LLM training onModal.
To get started, you can go through theQuickstartsection below, or paste the prompt below into your favorite agent:
Install the `modal-dojo` library. Then, install the skill bundle into the local project with `modal-dojo skills install`. Finally, tell the user that they can ask you to do something like: "Walk through tutorials/rl_basics.py and train Qwen3.5-4B to write 5-7-5 haikus from statworx/haiku."
Requirements:
- Python 3.12
Install the package directly:
uv pip install modal-dojo
Or add it to your project’s dependencies:
Watch the Modal Dojo dashboard substep view.Watch the Modal Dojo dashboard rollout view.
And empower your agents with the Modal Dojo’s skill bundle:
modal-dojo skills install
Then, it’s as easy as:
import refrom modal_dojo import ( HuggingFaceDataset, Qwen3_5_4B, Qwen3_5_4B_Recipe, TrainConfig,)model = Qwen3_5_4B()async def gsm8k_rm(args, sample, **kwargs) -> float: text = model.parse_response(sample.response or "").content boxed = re.findall(r"\\boxed\{([^}]+)\}", text) pred = boxed[-1] if boxed else (re.findall(r"-?[\d,]+(?:\.\d+)?", text) or [""])[-1] try: return float(float(pred.replace(",", "")) == float(sample.label)) except ValueError: return 0.0config = TrainConfig( model=model, dataset=HuggingFaceDataset( hf_repo="skrishna/gsm8k_only_answer", hf_split="train[:120]", input_column="text", output_column="label", input_format="text", ), recipe=Qwen3_5_4B_Recipe( custom_rm_function=gsm8k_rm, ),)if __name__ == "__main__": run = config.launch() print(run.training_run_id)
For a step-by-step walkthrough, see theGetting started tutorial.
Modal (@modal): Reflection Beam is now available on Modal.
Beam is a 501B-parameter open-weight MoE (23B active) from @reflection_ai built for coding, agentic workflows, and reasoning. It supports a 1M token context window, with token efficiency a core focus.
In early access, the Oura Health
Similar Articles
@modal: Reflection Beam is now available on Modal. Beam is a 501B-parameter open-weight MoE (23B active) from @reflection_ai bu…
Reflection AI 的 501B 参数开放权重 MoE 模型 Reflection Beam(23B 激活参数)现已在 Modal 平台上线,支持 100 万 token 上下文窗口,专注于编码、智能体工作流和推理任务。
@nanjiangwill: At @modal, we're working to make sure OSS RL frameworks have all the techniques necessary to train frontier open-weight…
Modal is enhancing OSS RL frameworks with delta compression and other techniques for training frontier open-weight models. The slime framework brings lossless delta sync to disaggregated training setups.
@_djdumpling: very exciting work and thrilled to be working on RL this summer at @modal!
A user expresses excitement about working on reinforcement learning at Modal, referencing Modal's announcement of an open-source library and lessons learned for scaling RL training.
@modal: GLM 5.3, the latest flagship model by @Zai_org, is now available on Modal.
GLM 5.3, the latest flagship AI model by Zai_org, has been released and is available on the Modal platform.
Beam: Reflection's 501B open-weight model
Reflection AI introduced Beam, a 501B-parameter sparse MoE open-weight model (23B active) built for coding, reasoning, and agentic workloads, pretrained on 23.8T tokens and scaled with a high-compute RL run on 10.5K GB300 GPUs. Beam is positioned as advancing the Western open-weight frontier, approaching GLM 5.2 and Qwen 3.8-Max on coding/agentic tasks while using 3–4× less inference compute, with weights and a technical report due later this month.