Tag
Presents an age-aware multi-task learning method for phoneme recognition from children's speech, enabling a lightweight 94M-parameter model to outperform larger models and run on edge devices like phones.
InclusionAI introduces Ling-3.0-tiny, a 7.9B-parameter hybrid reasoning MoE model with only 1.3B active parameters per token, optimized for efficient local and edge deployment.
RAG-HAR+ is a retrieval-first, cost-optimized extension of RAG-HAR for human activity recognition from wearable sensors. It uses a retrieval designer agent and majority voting to reduce LLM usage while maintaining accuracy, and demonstrates feasibility for edge deployment.
A tutorial on building a real-time object detection and tracking pipeline for robotics using ROS 2 and YOLOv11, covering threaded inference, ByteTrack integration, confidence validation, and ONNX export for edge deployment.
MCP has received a major update. The core protocol is now fully stateless, removing sessions and long-lived connections, making it better suited for serverless, edge deployment, and horizontal scaling. It's being called the biggest update since its release.
This article compares serverless, on-prem, and edge deployment for AI models, highlighting inefficiencies in current multi-model serving. It introduces the Superlinked Inference Engine (SIE), an open-source tool that serves multiple models on a single GPU by dynamically loading and unloading weights, aiming to reduce costs and complexity.
Proposes a two-stage structured pruning framework for LLMs that jointly optimizes latency and model size using multi-objective depth pruning and parallel Bayesian optimization, achieving favorable trade-offs for edge deployment.
This paper systematically evaluates how post-training quantization affects the interpretability of CNN models using Grad-CAM and LIME, revealing that classification accuracy is not a reliable indicator of interpretability stability and that architecture selection is critical for trustworthy deployment.
RobustMAD introduces a benchmark to evaluate the real-world robustness of multimodal small language models for deployable industrial anomaly detection assistants. It reveals critical failure modes and provides guidance for next-generation systems.
This paper systematically evaluates component-wise quantization of small vision-language models on Jetson edge devices, finding that model architecture (MoE vs dense) significantly affects quantization sensitivity and that quantization errors are largely additive except along modality-alignment paths.
This paper investigates the cross-domain generalization failure of lightweight ML models for IIoT intrusion detection, finding they rely on coarse port features and that adversarial robustness does not correlate with cross-network performance.
This paper benchmarks 17 compact language models (1B-8B parameters) as generators in Russian-language RAG systems under CPU-only inference, finding that Qwen-family models offer strong quality-latency tradeoffs for private, GPU-free deployment.
A systematic study of compressing recursive reasoning models for edge hardware finds that aggressive quantization destroys global reasoning while preserving local prediction. The paper introduces per-channel calibrated INT4 to recover reasoning ability and provides deployment recipes fitting 8 MB SoC and 4 MB MCU targets.
A tweet thread explains four AI agent deployment strategies: batch, stream, real-time, and edge, with detailed descriptions and use cases.
A benchmark study comparing traditional machine learning methods (Random Forest, XGBoost, SVM, Logistic Regression) against lightweight transformer variants (DistilBERT, TinyBERT, MobileBERT) for on-device fault detection across three public datasets. Traditional ML offers competitive accuracy at far smaller resource footprints, while TinyBERT-4L is the most deployment-friendly transformer.
Baidu's PaddlePaddle released PP-OCRv6, an OCR model supporting 48+ languages with tiny (1.5M), small (7.7M), and medium (34.5M) sizes, optimized for edge deployment and handwritten/printed/industrial/screen/card text.
Researchers from AMD propose Recover-LoRA, a method that uses low-rank adaptation with knowledge distillation on synthetic data to recover accuracy lost from aggressive 2-bit quantization of LLMs, achieving 80–95% accuracy recovery on 9 of 12 benchmarks for Qwen3-4B using only 10k synthetic samples.
Researchers from UiT and University of Oslo propose a differentiable NAS framework that jointly optimizes architectural configurations and mixed-precision quantization for LLM compression, achieving up to 1.4× faster inference or 6% higher accuracy across seven reasoning tasks compared to sequential NAS-then-quantization baselines.
RightNow-Arabic-0.5B-Turbo is an open 518M-parameter Arabic-specialized language model built on Qwen2.5-0.5B through vocabulary injection and continued pretraining, achieving competitive performance on Arabic benchmarks while being deployable on edge devices with quantization.
MiniCPM5-1B is fully open-sourced with weights, training data, and deployment code; it achieves top scores among sub-2B models and runs on edge devices.