Tag
User reports successfully running a 27B parameter model quantized to 1-bit on a Jetson Orin NX 16GB edge device, expressing amazement at the feasibility.
A developer built a fully offline suitcase robot named Sparky using a Jetson Orin NX and Gemma 4 E4B model, achieving ~200ms cached TTFT and 14-15 tok/s with 30+ sensors feeding into the prompt as natural language, all without network connectivity.