Tag
Cursor now allows running cloud agents on your own infrastructure with automatic scaling, enabling access to internal services and specialized hardware.
ENOVA is an open-source service that simplifies the deployment, monitoring, and auto-scaling of AI language models on GPU clusters, providing configuration recommendations and performance observability to improve efficiency.
This paper presents a dependency-aware autoscaling framework for serverless environments, integrating graph-based bottleneck identification, multi-model forecasting (MLP, LSTM, CNN) via a probabilistic ensemble, and cost-aware scaling control. Experiments show 99.88% prediction accuracy and reduced infrastructure costs.
Modal is enhancing OSS RL frameworks with delta compression and other techniques for training frontier open-weight models. The slime framework brings lossless delta sync to disaggregated training setups.