"Spent a lot on my rig but I can only run Gemma 4"

Reddit r/LocalLLaMA News

Summary

Google's first data center satellite, equipped with four Tensor Processing Units generating up to 1 kW, is now online in orbit to test large inference workloads in space, though TPU power limits restrict it to running a single chip for about 20 minutes at a time.

"The satellite, which carries four Google Tensor Processing Units (TPUs) and generates up to 1 kW of electricity, is intended to pave the way for future networks of close-flying satellites performing large inference workloads in orbit. However, the power demands of the TPU mean it can only turn one on for about 20 minutes at a time, complicating the already tricky business of space-to-ground communications." https://techcrunch.com/2026/10/30/googles-first-data-center-satellite-is-online-and-writing-poetry/ Anyone have any tips for Google here? Maybe they should try Qwen 3.8 27b?
Original Article

Similar Articles

Google’s first data center satellite is online and writing poetry

TechCrunch AI

Google's Suncatcher prototype space data center satellite is online and communicating with the ground after launching on a SpaceX Falcon 9, running Google DeepMind's Gemma 4 on onboard TPUs to perform inference in orbit. The test will assess how the chips handle space radiation and thermal stress, with two more satellites planned for 2027.

Gemma 12b less than 10 watts 6.5pp 1.3tg

Reddit r/LocalLLaMA

Running Gemma 12B model on a Google Pixel 10 Pro using llama.cpp achieves 6.5 tokens per second prompt processing and 1.3 tokens per second generation with under 10 watts power consumption, demonstrating efficient on-device AI inference.