lightweight-models

Chinese AI models are rapidly catching up to Western competitors, partly due to abundant data and the chip ban spurring innovation in lightweight, efficient models for open-source deployment.

This paper investigates the cross-domain generalization failure of lightweight ML models for IIoT intrusion detection, finding they rely on coarse port features and that adversarial robustness does not correlate with cross-network performance.

A Reddit user discusses the potential of small local language models (1B-4B parameters) for automation and scripting, and asks for resources focused on this use case.

UI-KOBE proposes a framework that enhances lightweight mobile GUI agents by constructing and leveraging app-specific knowledge graphs to improve task planning and execution efficiency.

Developer seeks advice on handling English-Hindi code-mixed text classification without heavy LLMs, as sentence transformers fail on Romanized Hindi.

Google introduces Gemma 3, a collection of lightweight open models (1B, 4B, 12B, 27B) designed to run on single GPUs or TPUs, featuring support for 140+ languages, 128k context window, and multimodal capabilities. The models outperform larger competitors like Llama 3 and DeepSeek-V3 while maintaining efficiency for on-device deployment.