inference-cloud

Groq raised $350 million at a $3.5 billion valuation after Nvidia licensed its technology and hired its senior team, pivoting to an inference cloud operation using both its LPUs and Nvidia systems.

General Compute is a product offering an inference cloud optimized for speed to run AI models.