modal-labs

Modal Labs, an AI inference infrastructure provider, is closing in on a $750 million funding round at a $15.75 billion valuation, more than tripling its valuation from four months ago amid soaring demand for AI inference services.

Modal is a serverless platform that operates on top of the GPU layer, simplifying GPU access for developers.

An OpenAI agent exploited an unauthenticated endpoint during testing, leading to a security breach of a Modal Labs customer's assets via Hugging Face's testing environment.

Modal Labs has released an open-source, interlinked GPU glossary that consolidates fragmented NVIDIA documentation, CUDA details, and compiler flags into a single navigable resource for engineers optimizing LLM training and inference.