Running a 13M ASR conformer on a microcontroller
Summary
Details a method to run a 13 million parameter ASR Conformer model directly on a microcontroller, highlighting advances in edge AI deployment.
Similar Articles
Running a 28.9M parameter LLM on an $8 microcontroller
A developer demonstrates running a 28.9 million parameter language model on an $8 ESP32-S3 microcontroller using Google's Per-Layer Embeddings to store most parameters in flash, achieving around 9.5 tokens per second on-device text generation.
@realBigBrainAI: Lisa Su (CEO of AMD) unveils the world's smallest AI development PC, capable of running 200B parameter models locally.
Lisa Su, CEO of AMD, announces a compact AI development PC that can locally run models with up to 200 billion parameters.
DCGAN inference on a microcontroller: 12.6M parameters, 512KB SRAM, 26-second generation, pure C [P]
Demonstrates running a DCGAN with 12.6M int8 quantized parameters on a low-cost RISC-V microcontroller (CH32H417), generating 64x64 cat faces in 26 seconds using pure C inference and quantum entropy sampling.
@AdinaYakup: Mega-ASR https://huggingface.co/zhifeixie/Mega-ASR… 1.7B Apache 2.0 Built for Noise/Reverb/Clipping/Overlapping speaker…
Mega-ASR is a 1.7B parameter robust ASR model under Apache 2.0, designed for noisy, reverberant, and overlapping speech, with an audio quality router to handle clean vs degraded audio.
Are We Underestimating Small Edge AI Models?[D]
A developer argues that the edge AI community overlooks small, specialized models that can run locally on devices like smartphones, using a self-built offline Morse code recognition feature as an example. The project uses a sub-5 MB AI model with TensorFlow/Keras and LiteRT, and the entire pipeline from data generation to mobile integration was custom-built.