tiny-llms

Tag

Cards List
#tiny-llms

Tiny LLM Benchmark: Jetson Orin Nano Super 8GB - Four Power Modes × Eight Models

Reddit r/LocalLLaMA · 2026-06-02

A deep benchmark of 8 tiny LLMs (135M to 1B parameters) on a $250 Jetson Orin Nano Super across four power modes finds 25W to be Pareto-optimal, with SmolLM2-135M achieving 165.1 tok/s and best efficiency.

0 favorites 0 likes
← Back to home

Submit Feedback