on-prem

The author attended the Mistral AI Now Summit in Paris, noting Mistral's shift from a model company to a full-stack AI provider, with emphasis on on-prem deployment, specialized small models, and European sovereignty.

Skymizer announces the HTX301, a PCIe inference card capable of running 700B-parameter LLMs on-premises with high memory and low power consumption.