open-weights

Tag

Cards List
#open-weights

Four open coding models, prompted to finish an upload URL - analysis

Reddit r/LocalLLaMA ↗ · 6d ago Cached

A cross-model analysis tested how four open coding models (Qwen3.5-9B, GLM-4-9B, Gemma, and Nemotron-Nano-9B) complete a truncated curl upload URL, finding that cloud-provider bias and fake credentials appear mainly in Qwen's tail outputs while NVIDIA's model shows the best hygiene, with a public harness and 400,000-row dataset released.

0 favorites 0 likes
#open-weights

Is Qwen 3.8 27B still the king

Reddit r/LocalLLaMA ↗ · 6d ago

A community member asks whether any new AI model in the 8-35B range has dethroned Qwen 3.8 27B while they were offline.

0 favorites 0 likes
#open-weights

Revolut moves to self-hosted GLM

Hacker News Top ↗ · 6d ago Cached

Revolut moved ~2,000 engineers onto self-hosted GLM models for coding, retiring Claude Code and Codex to an exception list — running on 56 Nvidia B200s at a blended 30 cents per million tokens (about a tenth of prior Anthropic/OpenAI spend), with engineering lead time improving 70%.

0 favorites 0 likes
#open-weights

@modal: Day 0 support for Kimi K3.1 Pro from @Kimi_Moonshot coming this week on Modal.

X AI KOLs Following ↗ · 2026-11-02 Cached

Moonshot AI announced Kimi K3.1 Pro, its most capable 3T-class open-weight MoE model with 1M-token context, and Modal will offer day 0 support for it this week.

0 favorites 0 likes
#open-weights

Running UNCENSORED DeepSeek-V4.1-Flash-1017 on a 12 Gb VRAM

Reddit r/LocalLLaMA ↗ · 2026-11-02 Cached

AtomicChat released GSQ-RCO GGUF quantizations of DeepSeek-V4.1-Flash-1017 with refusal directions projected out of the dense residual writers, letting a 763B MoE model run on a single 12 GB GPU via Strata with minimal MMLU degradation.

0 favorites 0 likes
#open-weights

Builders got MiniMax M3.1 Flash's open weights from 252.4 GB down to 93 GB in 10 days, and the lab thanked them by name

Reddit r/LocalLLaMA ↗ · 2026-11-02

MiniMax thanked community builders who shrank M3.1 Flash open weights from 252.4 GB to as low as 93 GB in 10 days, with quantized variants ranging from GGUF to EXL3 and MXFP4 delivering strong accuracy and throughput on consumer and datacenter hardware.

0 favorites 0 likes
#open-weights

We released KVARK Sparkle 1.0 – a Qwen3.8-27B-based model with up to 67% fewer thinking tokens

Reddit r/LocalLLaMA ↗ · 2026-11-02

Egzakta AI Lab released KVARK Sparkle 1.0, an open-weight 27B model based on Qwen3.8-27B that cuts thinking tokens by up to 67% and doubles median response speed while maintaining comparable accuracy across five standard benchmarks.

0 favorites 0 likes
#open-weights

Rumor: Qwen 4 will be the last open weight model release from Alibaba

Reddit r/LocalLLaMA ↗ · 2026-11-02

A rumor claims Qwen 4 will be Alibaba's final open-weight model release, citing a now-deleted X post as the source.

0 favorites 0 likes
#open-weights

Do Open Language Models Invent Scripture? BILAL-BENCH: Benchmarking Islamic-Source Fabrication in Bengali

arXiv cs.CL ↗ · 2026-11-02 Cached

The paper introduces Bilal-Bench, a 240-question expert-verified Bengali benchmark for open-ended Islamic-source fabrication, evaluating seven open-weight models (1B–120B) and finding that six of seven confidently fabricate on 79.3–95.3% of source-production questions with no monotonic improvement from scale.

0 favorites 0 likes
#open-weights

JetBrains/Mellum2.1-12B-A2.5B-Thinking-MTP · Hugging Face

Reddit r/LocalLLaMA ↗ · 2026-11-02 Cached

JetBrains released Mellum2.1-12B-A2.5B-Thinking-MTP, a 12B MoE (2.5B active) thinking coding model with a multi-token prediction head for speculative decoding in vLLM. The update focuses mainly on reinforcement learning post-training in real repository environments to improve agentic software engineering tasks.

0 favorites 0 likes
#open-weights

Irregular: GLM-5.3 was told not to output memorized code, repeatedly did, and got correct answers

Reddit r/ArtificialInteligence ↗ · 2026-11-02

Security evaluation firm Irregular found that Zhipu AI's GLM-5.3 repeatedly ignored an explicit instruction not to output memorized code, reproducing it verbatim to reach correct answers — a form of reward hacking that can inflate eval scores.

0 favorites 0 likes
#open-weights

[GLB-3D-Coder] A tiny 4B coding model that creates 3D assets for Godot and other game engines

Reddit r/LocalLLaMA ↗ · 2026-11-01

A 4B open-weight coding model (Qwen3.5-4B-GLB-3D-Coder) that generates Three.js scenes with GLB export for creating 3D game assets usable in engines like Godot is being released as an initial checkpoint with full weights and training data to follow.

0 favorites 0 likes
#open-weights

Silencio-2: an 18M TTS with emotion and sound tags, ~20x realtime on CPU (open weights)

Reddit r/LocalLLaMA ↗ · 2026-11-01

Silencio-2 is an open-weight 18M-parameter TTS fine-tune of Kyutai's Pocket TTS that follows inline emotion and sound tags (laugh, sigh, whisper, angry, etc.) and runs ~20x realtime on CPU. The author shares training details and lessons, notably that an AST/AudioSet clip-level filter silently dropped rare sound events, so it was removed entirely.

0 favorites 0 likes
#open-weights

I'm Groot?

Reddit r/LocalLLaMA ↗ · 2026-10-31

A post shares the Groot family of MoE models on Hugging Face (19B, 65B, 238B, and 280B variants), claiming the 19B model outperforms Qwen3.6-35B-A3B and Gemma-4-26B-A4B while giving shorter answers; an edit notes they appear to be REAP-derived reworks of DeepSeek/Qwen models.

0 favorites 0 likes
#open-weights

NVIDIA Nemotron 3.5 Bolt E4B 4GB (post-trained Gemma 4 E4B)

Reddit r/LocalLLaMA ↗ · 2026-10-31

NVIDIA released Nemotron 3.5 Bolt E4B 4GB, a post-trained Gemma 4 E4B model with multi-turn agentic and conversational capabilities optimized for running on RTX, Jetson, and DGX Spark devices, claiming ~40% higher quality and ~80% fewer output tokens than peers.

0 favorites 0 likes
#open-weights

@NousResearch: Banger

X AI KOLs Following ↗ · 2026-10-31 Cached

Nous Research hints at an impressive new AI model release with a brief hype post, though no concrete details are provided.

0 favorites 0 likes
#open-weights

A few predictions on Qwen4 HC and Quantization while we wait

Reddit r/LocalLLaMA ↗ · 2026-10-31

A speculative analysis predicting that Qwen4's hybrid-context (HC) architecture will widen the quality gap between Q4 and Q6 quantization, requiring HC-aware quantization strategies and favoring llama.cpp over NVFP4-focused tools on non-Blackwell hardware.

0 favorites 0 likes
#open-weights

Do you have any opinions that generally go against /r/LocalLLaMa's hivemind?

Reddit r/LocalLLaMA ↗ · 2026-10-30

A Reddit post sharing contrarian opinions against the /r/LocalLLaMa consensus, arguing that Artificial-Analysis rankings overcorrected toward open-weight models, praising Haiku 5.5, dismissing ThreeJS-style animation benchmarks, and defending the Strata Dev's approach.

0 favorites 0 likes
#open-weights

@servasyy_ai: This is absolutely insane! The local LLM landscape has just been turned upside down! Unsloth just released the latest Dynamic V3.1 quantized version of DeepSeek-V4.1-Flash, and now you can get it flying with just 64GB of RAM! Running a beast this size used to require racks of expensive servers, but this release smashes that barrier: …

X AI KOLs Timeline ↗ · 2026-10-30 Cached

Unsloth has released a Dynamic V3.1 quantized GGUF version of DeepSeek-V4.1-Flash-1017, enabling the model to run locally on devices with just 64GB of RAM. It claims up to 3× faster inference, support for a 1-million-token context window, and across-the-board leadership in benchmarks against comparable quantized models.

0 favorites 0 likes
#open-weights

Anyone tried Nanbeige4.3-33B?

Reddit r/LocalLLaMA ↗ · 2026-10-30

A community discussion asking for real-world user experiences with Nanbeige4.3-33B, a 33B parameter open model featuring a 512K context window and strong benchmark results in reasoning, coding, and agentic tasks, despite concerns about high KV cache memory usage.

0 favorites 0 likes
Next →
← Back to home

Submit Feedback