local-models

Tag

Cards List
#local-models

Qwen 3.8 27b is sometimes so smart it scares me...

Reddit r/LocalLLaMA ↗ · 2026-11-02

A user reports that Qwen 3.8 27b, a local model, autonomously discovered it could access Blender via MCP and wrote Python code to speed up its math on a physics problem — behavior the user says they've never seen from a local model before.

0 favorites 0 likes
#local-models

@grant5407: Let AI tap through your phone apps while you go about your day? Mika: an open-source Android assistant that, from a single prompt, opens apps on a background screen, reads group chats, compares prices and adds to cart — pausing to ask you before payment. No Mika servers involved; bring your own model API key. Note: requires wireless debugging; the README warns that automating apps may violate their terms…

X AI KOLs Timeline ↗ · 2026-11-02 Cached

Mika is an open-source Android AI assistant that operates your phone apps on a background virtual screen (sending messages, reading group chats, comparing prices, adding to cart, etc.). It supports bringing your own model API key and doesn't route through their servers. It has already gained 3,810 stars in about 3 days since launch.

0 favorites 0 likes
#local-models

@rauchg: Own your intelligence. Anyone that opposes this has something to sell you (perhaps your own intelligence back to you.) …

X AI KOLs Timeline ↗ · 2026-11-01 Cached

rauchg argues for owning your AI stack by running local models and embracing open source, urging users to control their harness, data, connections, runtime, and agents rather than letting others resell their intelligence.

0 favorites 0 likes
#local-models

How do I make search with local models feel like ChatGPT / Codex?

Reddit r/LocalLLaMA ↗ · 2026-10-31

A developer asks how to make local-model research and search (using Crawl4AI + SearXNG) perform on par with ChatGPT/Codex, reporting missing, outdated, and low-relevance results with models like GLM 5.3 Flash and DeepSeek V4.1 Flash across harnesses such as ZCode and OpenCode.

0 favorites 0 likes
#local-models

Standard for websites & extensions to use local models, proposed by Opera

Reddit r/LocalLLaMA ↗ · 2026-10-31

Opera has proposed a new standard enabling websites and browser extensions to run and leverage local AI models, aiming to standardize on-device AI capabilities across the web ecosystem.

0 favorites 0 likes
#local-models

update on the multi-step agent guardrail i scoped here a few weeks ago

Reddit r/AI_Agents ↗ · 2026-10-29

The author shares a first working version of a multi-step agent guardrail that re-checks the facts an irreversible action depends on right before execution, plus a benchmark reporting catch rate and false-alarm rate separately — achieving 0% false alarms after conservative normalization while running on a local Qwen2.5-7B model.

0 favorites 0 likes
#local-models

OpenLLM

Product Hunt ↗ · 2026-10-28 Cached

OpenLLM 是一款开发者工具,让你把订阅、API 密钥和本地模型接入 Codex、任意编码代理,甚至 Mac 上的 ChatGPT 应用,突破限额后可无缝继续,并支持从任何地方启动编码会话。

0 favorites 0 likes
#local-models

[Follow-up] Single agent or multi-agent? I ran the same build through 4 setups from my last thread

Reddit r/AI_Agents ↗ · 2026-10-27

The author ran the same Python build task through four agent setups—Claude Code single agent, Codex CLI single agent, a Paseo lead/worker team, and Atomic Agent Fusion mode—and compared speed, hidden-test results, and API cost. Single agents were fast and perfect, while orchestration's main win was cost efficiency via local worker models rather than speed.

0 favorites 0 likes
#local-models

@servasyy_ai: If you want to set up your own Harness + local model setup, I recommend checking out this article on Pi Agent — it's beginner-friendly. Also, let me introduce a related project I've been using with Pi Agent: https://github.com/openpi-dev/openpi…

X AI KOLs Timeline ↗ · 2026-10-22 Cached

A tweet recommending Pi Agent for beginners looking to set up Harness + local model tuning, along with an introduction to OpenPI — a companion open-source project that provides a local web workbench, isolated-context sub-agents, and multi-stage workflow capabilities for Pi.

0 favorites 0 likes
#local-models

Open source LLM appreciation post

Reddit r/LocalLLaMA ↗ · 2026-10-22

用户表达对开源 LLM 生态的赞叹,提到下载了 Raon-1-mini 30B A4B 和 Flint 40B A2.5B 等多国开源模型,并对能与计算机自然对话感到惊喜。

0 favorites 0 likes
#local-models

@cline: We’re about to see a breakout in local model capabilities. Flint scores 54.9% on Terminal-Bench 2.1 with ~2B active par…

X AI KOLs Timeline ↗ · 2026-10-21 Cached

Flint scores 54.9% on Terminal-Bench 2.1 with only ~2B active parameters, outperforming other small MoE models and some dense ~30B models while running at 125+ tok/s on a MacBook Pro with ~24GB memory.

0 favorites 0 likes
#local-models

@TheAhmadOsman: We're just getting started btw

X AI KOLs Timeline ↗ · 2026-10-20 Cached

Tweets highlight long queues at the RTX Spark official launch in San Francisco, where demos built with the ODS software running a local model (Qwen 3.8 Next Flash) are being showcased.

0 favorites 0 likes
#local-models

Jev Based Adaptive Thinking for LLMs

Reddit r/LocalLLaMA ↗ · 2026-10-19

An open-source experiment applying Jevons-style (JEV) logic to make LLM thinking adaptive: the model measures per-word entropy and triggers additional parallel thinking blocks only when uncertainty is high, selecting the best branch via tree search. Aimed especially at users running local models who can leverage parallel decoding streams.

0 favorites 0 likes
#local-models

Show HN: Pulse Local, a Mac budgeting app whose AI models run on your machine

Hacker News Top ↗ · 2026-10-13 Cached

Pulse Local is a Mac budgeting app that runs its AI models entirely on-device, keeping financial data and questions private while offering features like plans, targets, rollover, splits, and cash flow. It uses small local models with a double-reading verification approach for money answers and uses a pay-what-you-want one-time pricing model.

0 favorites 0 likes
#local-models

open-source desktop agent app running its agents on local ollama models: two agents on qwen3.5:9b and qwen3.8 on a 16 gb card, real recording, including the limits i hit

Reddit r/LocalLLaMA ↗ · 2026-10-13

Dodaios 的维护者展示了一款 Apache 2.0 开源桌面 AI 代理应用,可在本地 Ollama 模型(Qwen3.5:9b 和 Qwen3.8-16gb)上运行多代理任务,并坦诚说明了本地模型在工具调用上的局限。

0 favorites 0 likes
#local-models

Our planner agent kept doing the work itself, so now it can't write a single file during its turn

Reddit r/AI_Agents ↗ · 2026-10-12

Atomic Agent (open source, MIT) introduces a strict planner/worker separation in its Fusion mode, where the planner is never allowed to mutate files or call mutating tools — only read, delegate, and review. The post details how earlier soft gates failed and announces an importer for migrating setups from six other agents, plus a new desktop app.

0 favorites 0 likes
#local-models

@WescheNex1q: GLM 5.3 Flash vs Deepseek V4.1 vs Qwen 3.8 Flash Next: Same prompt, 3 local models, one HTML file each: a cinematic 3D …

X AI KOLs Following ↗ · 2026-10-12 Cached

A head-to-head comparison of three local models—GLM 5.3 Flash, DeepSeek V4.1, and Qwen 3.8 Flash Next—each generating a cinematic 3D Three.js spiral galaxy HTML file on DGX Sparks, with stats on tokens, generation time, throughput, and fixes needed.

0 favorites 0 likes
#local-models

@BenjaminDEKR: This is kind of genius

X AI KOLs Timeline ↗ · 2026-10-11 Cached

一位开发者分享了一个小游戏:让 LLM 守卫一个保险箱,玩家通过聊天、欺骗或直接破解来套出密码,并可扮演机器人或进行 AI 对 AI 实验,支持 Codex 应用和本地模型。

0 favorites 0 likes
#local-models

Goodbye Coding Plans

Reddit r/LocalLLaMA ↗ · 2026-10-10

作者预言大约一年后,本地模型配合良好的 harness 就能编写 90% 的代码,并点名期待 Qwen 的表现,随后补充说许多人认为 Qwen3.8 Next Flash 已经接近这一水平,自己要去试一试。

0 favorites 0 likes
#local-models

Engineer / developer observations of Gemma4-31B, Qwen3.8-27B, and 6.1-Sol for software engineering work

Reddit r/LocalLLaMA ↗ · 2026-10-10

A 20-year software engineer compares Gemma4-31B and Qwen3.8-27B (Q4, via Codex CLI and OpenCode CLI) on codebase analysis and greenfield C#/WPF app authoring, finding both workable locally but clearly behind GPT 6.1-Sol, which delivered a one-shot A+ result.

0 favorites 0 likes
Next →
← Back to home

Submit Feedback