qwen

The author built a local realtime voice stack using Parakeet STT, Qwen 2.5 7B, and Qwen3-TTS, integrated with Ollama.

The author shares excitement for the upcoming Qwen 3.8 model, highlighting their experience with Qwen 3.6 27B for local LLM use, and discusses the potential of self-hosted AI to replace subscription-based frontier models.

A local experiment comparing Qwen 35B-A3B MoE and Qwen 27B dense on coding-maintenance tasks, finding the MoE model ~3.9× faster with a smaller quality gap than expected.

Alibaba released Qwen3.8-Max, a 2.4 trillion-parameter sparse MoE model with 95B active parameters per token, 1M token context, and strong agentic and benchmark results, including autonomously coding for days, circuit design, and outperforming rivals on Terminal Bench and PaperBench.

A user shares their llama.cpp server configuration for running Qwen 3.6 27B on an RTX 5090, achieving 80-100 t/s, and asks the community for alternative settings and tips.

Recommends pairing DeepSeek v4 flash with qwen3.7-flash to add multimodal image understanding capabilities to DeepSeek at low cost, and provides simple configuration steps using Alibaba Cloud Bailian and Codex.

A discussion questioning whether older AI models like GLM 5.2 and Kimi 2.7 remain relevant for coding now that newer models such as Kimi K3, Qwen 3.8 Max, and DeepSeek V4 Pro are arriving.

The article criticizes Artificial Analysis's intelligence index, claiming that a sudden v4.1.1 update reweighted metrics to downgrade the open-source Qwen 3.8 Max below Anthropic's Claude Opus, suggesting bias or sponsorship influence.

A user on a dual RTX 3090 setup discovers that llama.cpp's --split-mode tensor runs prompt processing on CPU (~400 t/s), while switching to --split-mode layer unlocks GPU prompt processing over 1600 t/s, with only a modest drop in token generation speed.

Qwen3.8 Max is now ranked as the best overall model on Artificial Analysis's agentic index, surpassing other leading AI models in independent evaluations.

A developer benchmarks Qwen3.6-35B-A3B Q6 on an RTX 3090, showing that offloading eight MoE expert layers to CPU and increasing batch sizes improves prompt processing by 2.36× (564→1330 tok/s) with no decode speed regression, using evolutionary search to find the tuning config.

Announces the open release of Qwen3.8-2.4T-A95B (aka Qwen3.8-Max) next Wednesday, with a ModelScope link.

bootai is an open-source UEFI application that boots directly into an AI chat/code REPL, running Qwen2.5 and SmolLM model inference on bare metal without an OS, with hand-written network drivers and a TCP/IP stack.

HuggingModels announces the release of Qwen3.6-35B-A3B-Uncensored-Genesis-Hermes-V7-GGUF, a fine-tuned and quantized version of the Qwen model.

QwenCloud unveiled Qwen-Image-3.0-Pro, a powerful image generation model supporting dense layouts, tiny text rendering, and native multilingual output, positioning it as a deployable productivity tool.

Qwen developers held an AMA on Twitter, confirming an upcoming 27B model, sharing details about Qwen 3.8's 2.4T parameters and 95B active, and noting the community's influence on releases.

This paper investigates the failure modes of converting Qwen3-0.6B-Base attention layers to KDA linear attention on a single GPU, identifying an 'interface injury' where the model predicts option labels rather than content, and proposes a format-targeted KL stage to repair it.

A user asks about Mach-1 Additive, a model reportedly achieving 95% of Qwen 3.6 35B's performance while being 10x smaller, questioning why it isn't more widely discussed.

User benchmarks DeepSeek v4 Flash against Qwen3.6-27B, Qwen3.5-122B, and Gemma 4 31B on a local coding benchmark, finding Flash wins overall but Qwen 122B performs surprisingly well with better first-try success and lower token usage.

Cline announces that Qwen3.8-Max is now available through ClinePass, a subscription offering roughly 5x discounted access, with a special $4.99 promo for the Cline CLI.