edge-hardware

Tag

Cards List
#edge-hardware

Offline AI Modules: Voice-First Offline Architecture, Hardware Reference Stack, Quantization and Benchmarking

arXiv cs.AI ↗ · 2026-10-08 Cached

This paper presents the first end-to-end benchmark of a voice-first offline AI stack for African language communities, evaluating three instruction-tuned 2–5B models across four quantization formats on NVIDIA Jetson Orin NX and Raspberry Pi 5 hardware, finding that Q4_K_M offers the best size-to-quality trade-off.

0 favorites 0 likes
← Back to home

Submit Feedback