on-device

Tag

Cards List
#on-device

Tencent's Hy team says a Hy4-mini and a "Flash-Lite" are both on the roadmap. What size do you actually want?

Reddit r/LocalLLaMA ↗ · 35m ago

Tencent's Hy (Hunyuan) team revealed in an AMA that an Hy4-mini, a ~35B-A3B Flash-Lite model, and a possible 24-31B dense model are all on the roadmap, with Engram and iHC claimed to benefit smaller models especially and on-device variants being co-designed with edge GPU hardware.

0 favorites 0 likes
#on-device

Inkling 2 Mini

Hacker News Top ↗ · 19h ago Cached

Thinking Machines releases Inkling 2 Mini, a 26.4B-total/3.4B-active open-weights Mixture-of-Experts looped transformer that runs in ~20GB on laptops and leads sub-100B models on agentic coding benchmarks like DeepSWE v1.1. A research variable-loop variant is released alongside it to study monitorability, showing improved no-CoT time horizons and legible chain of thought without increased sabotage tendencies.

0 favorites 0 likes
#on-device

Embla 1 (5 minute read)

TLDR AI ↗ · 5d ago Cached

Sevren released Embla 1, a phone-optimized reasoning model that runs privately and offline at 4 bits, averaging 57.4 across five benchmarks with 1.77 s end-to-end latency on an iPhone 18 Pro, outperforming larger small models at comparable or lower latency. It uses a custom MoE architecture with sparse attention, shared K/V caches, and a memory table, trained with QAT and multi-stage distillation from Qwen3.5 models.

0 favorites 0 likes
#on-device

LiquidCodec: High-Fidelity Audio Tokenization Optimized for Speed (17 minute read)

TLDR AI ↗ · 2026-11-13 Cached

Liquid AI introduces LiquidCodec, a ~74M-parameter streaming audio codec built on the LFM3 architecture that turns speech into tokens for its LFM3-Audio-2B and LFM3-Omni-2B models, matching peers in reconstruction fidelity and compression while delivering much faster token-to-waveform decoding for on-device use.

0 favorites 0 likes
#on-device

NVIDIA Nemotron 3.5 Bolt E4B 4GB (post-trained Gemma 4 E4B)

Reddit r/LocalLLaMA ↗ · 2026-10-31

NVIDIA released Nemotron 3.5 Bolt E4B 4GB, a post-trained Gemma 4 E4B model with multi-turn agentic and conversational capabilities optimized for running on RTX, Jetson, and DGX Spark devices, claiming ~40% higher quality and ~80% fewer output tokens than peers.

0 favorites 0 likes
#on-device

Arc: a ~70 MB streaming speech model that transcribes links names and metadata to your own list as they're spoken, with no second model

Reddit r/ArtificialInteligence ↗ · 2026-10-29

Arc-Transcriber is a ~70MB streaming speech model that performs ASR and NER/entity-linking in a single step, outputting transcripts, linked names, numbers, speaker roles, and audio events every 100ms via trained heads on a shared encoder, eliminating the usual multi-model pipeline. Two variants (Arc mini and Arc-v1) are released with weights on Hugging Face and code on GitHub.

0 favorites 0 likes
#on-device

@xenovacom: We've just made a breakthrough: the first true omni model running 100% locally in a browser... fully end-to-end, with n…

X AI KOLs Timeline ↗ · 2026-10-29 Cached

Xenova 宣布突破:首个 100% 本地在浏览器中运行的真正全模态模型 LFM3-Omni-2B,借助自定义 WebGPU kernels 实现约 280 tok/s,支持视觉、音频和文本输入并生成交错的文本与音频输出。

0 favorites 0 likes
#on-device

OpenBMB just put a 1B OCR model on an iPhone, and it can even check its own results

Reddit r/LocalLLaMA ↗ · 2026-10-28

OpenBMB released MiniCPM-OCR 1.0 (1B), a lightweight OCR model that runs locally on iPhone/iPad, plus MiniCPM-OCR-Jev (2B), a verifier that scores OCR output correctness against the source image; both ship with open weights and support llama.cpp, vLLM, SGLang, and Ollama.

0 favorites 0 likes
#on-device

LiquidAI/LFM3-Omni-2B-GGUF

Reddit r/LocalLLaMA ↗ · 2026-10-27 Cached

Liquid AI 发布 LFM3-Omni-2B 的 GGUF 版本,支持在 CPU/GPU 上本地推理。该模型可理解文本、图像、视频和音频,并以文本和语音输出,专为设备端使用打造。

0 favorites 0 likes
#on-device

@maximelabonne: "Can I run my model on a lamp?" is the new benchmark, I guess

X AI KOLs Following ↗ · 2026-10-27 Cached

Liquid AI 工程师展示 LFM3-Audio 模型在本地设备(一盏灯)上运行并进行语音对话,网友戏称"能否在灯上跑模型"正成为新的基准。

0 favorites 0 likes
#on-device

LFM3 by Liquid AI

Product Hunt ↗ · 2026-10-27 Cached

Liquid AI 发布第三代 Liquid Foundation Models(LFM3),首批包含六个 2B 级模型,覆盖文本、视觉、音频、全模态和决策任务,采用开放权重并共享主干架构,可在手机、笔记本和边缘设备上运行,权重已上线 Hugging Face。

0 favorites 0 likes
#on-device

Introducing LFM3: Every Modality for Specialized Intelligence

Hacker News Top ↗ · 2026-10-27 Cached

Liquid AI 推出新一代 Liquid Foundation Models 系列 LFM3,采用共享骨干的多模态(文本、视觉、音频、全模态、决策)混合架构,首批 2B 参数级模型开放权重,可本地微调并跨设备运行。

0 favorites 0 likes
#on-device

NotiKeep

Product Hunt ↗ · 2026-10-27 Cached

NotiKeep 是一款 iPhone 通知历史记录应用,利用 iOS 27 Shortcuts 自动化在本地保存通知,支持查看已删除或已编辑的消息、按应用与会话搜索,以及关键词提醒,全程本地处理、无需账号。

0 favorites 0 likes
#on-device

Block’s new voice model sounds eerily human

TechCrunch AI ↗ · 2026-10-24 Cached

Block released Dessa, a full-duplex speech-to-speech voice model trained entirely on human speech that runs locally on consumer GPUs and produces expressive, human-like conversation with built-in emotion.

0 favorites 0 likes
#on-device

LiquidAI/LFM3-1.7B

Hugging Face Models Trending ↗ · 2026-10-23 Cached

Liquid AI released LFM3-1.7B, a 1.73B-parameter tri-hybrid text model designed for local agents and edge deployment with a 256K-token context window, fitting in about 1 GB of memory at 4-bit precision and supporting single-GPU fine-tuning for domain specialization.

0 favorites 0 likes
#on-device

Making Kokoro TTS 50-100x faster without knowing how

Reddit r/LocalLLaMA ↗ · 2026-10-22 Cached

A free in-browser TTS tool that runs entirely on-device using a 2.7 MB model on a custom 136 kB WebAssembly engine, making Kokoro-distilled Paradee 12.9x faster while maintaining quality. The author breaks down each optimization step and lets users benchmark it live in their browser.

0 favorites 0 likes
#on-device

We shrank our steerable small TTS to 11.84 MB. WER is unchanged, UTMOS drops ~0.1 [p]

Reddit r/MachineLearning ↗ · 2026-10-22

WhissleAI released SteerTTS-Edge, a steerable small English TTS model compressed to 11.84 MB via int4 quantization-aware training of the acoustic model and a distilled Vocos vocoder, with unchanged intelligibility (WER 0.96%) and only a ~0.1 UTMOS drop while preserving all 12 steering controls.

0 favorites 0 likes
#on-device

Ran a 0.9B transcribe + diarize model on a 17.5 minute, 4 person AMI meeting on a MacBook: all 4 speakers found, 0.08% speaker confusion, done in 12 minutes

Reddit r/LocalLLaMA ↗ · 2026-10-22

作者在 MacBook Pro (M5 Pro, 64GB) 上用 MPS 后端运行 0.9B 的 MOSS-Transcribe-Diarize 模型,对 AMI 测试集一段 17.5 分钟、4 人会议做单次转写+说话人分离,仅用 12 分钟(约 0.68x 实时)完成,4 位说话人全部识别,说话人混淆率仅 0.08%,DER 为 15.4%,并能正确处理重叠对话。

0 favorites 0 likes
#on-device

@AdinaYakup: Happy to see another on device model Spark-X2.6-4B from @SparkLLM - 4B + Apache 2.0 - Up to 1M context - 3 thinking mod…

X AI KOLs Following ↗ · 2026-10-22 Cached

SparkLLM 釋出 Spark-X2.6-4B 端側模型,具備 4B 參數、Apache 2.0 授權、最高 1M context 與 3 種思考模式,並支援 GGUF 本地部署。

0 favorites 0 likes
#on-device

LiquidAI/LFM3-Omni-2B

Hugging Face Models Trending ↗ · 2026-10-21 Cached

Liquid AI 发布 LFM3-Omni-2B,其 LFM3 家族首款全模态模型,可理解文本、图像、视频和音频,并以文本和语音作答,专为手机、笔记本等边缘设备设计,2.2B 参数即可替代独立的 ASR、VLM、LLM 和 TTS 模型。

0 favorites 0 likes
Next →
← Back to home

Submit Feedback