@charles_irl: I didn't have wifi on my flight from SF to Seoul for ICML, so instead of coding, I wrote this article on my favorite an…
Summary
Charles wrote an article explaining what Modal is while on a flight to ICML in Seoul.
Similar Articles
@charles_irl: https://x.com/charles_irl/status/2073975754833203706
In a Twitter thread, the founder of Modal explains that the platform is best understood as a computer, drawing parallels between traditional computer architecture and Modal's serverless cloud infrastructure.
@charles_irl: Added a smol new section to last week's blog post on the technical internals of @modal's fast cold boots. This section …
Modal explains how it reduces AI inference cold starts by 40x using cloud buffers, a custom filesystem, checkpoint/restore, and CUDA checkpoint/restore, framing cloud buffer management as a linear optimization problem solved with GLOP.
@charles_irl: When You were wrapping OpenAI, I studied 𝕋𝕙𝕖 ℂ𝕌𝔻𝔸 When you were having VC chats, I mastered 𝔗𝔥𝔢 ℑ𝔫𝔣𝔢𝔯𝔢𝔫�…
Modal Jazz is a complete open AI stack using Modal, DeepSeek V4 Pro, and SGLang for self-hosted language model inference, with frontends like OpenCode, OpenClaw, and Vercel AI SDK.
@charles_irl: Proper post-training RL, deployed broadly, is a key step towards a future where software systems quietly improve themse…
Modal announces an open-source library for reinforcement learning on its platform, addressing infrastructure challenges in post-training RL with scalable deployment.
@charles_irl: more vibe checks available from your friendly local lunatics at r/localllama https://reddit.com/r/LocalLLaMA/s/vqBVXvIT…
Modal announces day 0 support for Step 3.7 Flash, a 198B parameter MoE model with 256K context and native image/video understanding.