@wei_wang: JetBrains officially launches Junie Local, getting serious about local AI Coding Agent. A company that truly owns IDE, code indexing, refactoring tools, and engineering context starts redesigning the entire Agent Harness for local models. One life…

X AI KOLs Timeline Products
ai-coding local-agent jetbrains junie-local ide optimization ai-model

Summary

JetBrains officially launches Junie Local, a local AI Coding Agent that optimizes local models like Qwen3.6-27B for offline operation, tuned for speed and stability.

JetBrains officially launches Junie Local, getting serious about local AI Coding Agent. A company that truly owns IDE, code indexing, refactoring tools, and engineering context starts redesigning the entire Agent Harness for local models. 1. One command to start In Junie, enter /local The system will automatically download the model, start the local inference service, and switch to Junie Local. No API key, subscription, credits, or cloud service needed; once the model is downloaded, it can run completely offline, with prompts, code, and diffs kept locally. The initial requirement is M5 Mac with 64GB RAM, using the Qwen3.6-27B 4-bit model, with a download size of about 20GB. 2. Why choose Qwen3.6 instead of Qwen3.8 JetBrains testing found that with Qwen3.6-27B, disabling reasoning leads to minimal quality degradation but reduces output tokens by two to three times, nearly doubling task execution speed. With Qwen3.8-27B, disabling reasoning can cause significant quality drops and even repeated calls to the same tool. Enabling medium reasoning increases generated tokens by about five times, slowing down complete tasks by nearly four times. Thus, on current Mac hardware, JetBrains opted for Qwen3.6 for a better balance of speed and stability. 3. Their optimization focus is not solely on decode speed Coding agents spend much of their time reading project files and processing long prompts, where prefill often has a greater impact on user experience than token-by-token generation. JetBrains redesigned Junie's rolling context to keep files already read by the model in context, allowing subsequent tasks to reuse the KV cache without repeated prefilling. They also adjusted the order of system prompts and project context to enable more fixed prefixes to be reused across tasks. 4. For local inference, they proactively removed some features Junie Local disables unnecessary LLM calls, such as automatic task summary generation. Multi-agent is also disabled, as M5's most efficient approach is sequential execution. Parallel agent launching would still bottleneck on the same inference engine. This shows that local agents cannot simply copy cloud workflows; the harness must be redesigned based on hardware. 5. They also made several low-level optimizations 4-bit quantization is about twice as fast as 8-bit in generation speed. Leveraging M5's 8-bit arithmetic instructions to optimize prefill improved throughput by about 40%. M4 lacks these instructions, making prefill about 20% to 30% slower. With MTP and N-gram speculative decoding enabled simultaneously, generation speed can increase by up to two times. JetBrains claims that in internal private tests, the local Qwen3.6-27B with reasoning disabled can achieve results close to Sonnet 4.5 with 10K reasoning tokens, with GPT-5 Medium slightly higher. This is from the vendor's own tests and cannot be taken as a universal benchmark, but it at least indicates that specially tuned local models can now handle daily refactoring, test completion, dependency upgrades, codebase understanding, and repetitive engineering tasks. Currently, Junie Local is only officially supported on M5 Mac, but JetBrains has prototypes for DGX Spark and RTX 5090, and is researching 24GB GPUs. The truly important trend is now clear. The competition in local AI coding is shifting from "which model scores higher" to "who can integrate the model, inference engine, KV cache, IDE, and agent loop into a complete system." The model is just the engine. The harness and engineering optimizations determine whether it can actually get the job done.
Original Article
View Cached Full Text

Cached at: 08/25/26, 08:10 PM

JetBrains officially launches Junie Local, committing seriously to local AI Coding Agents.

A company that truly possesses an IDE, code indexing, refactoring tools, and engineering context begins redesigning its entire Agent Harness for local models.

1. Start with a single command

In Junie, enter
/local

The system will automatically download the model, launch a local inference service, and switch to Junie Local.

No API key, subscription, credits, or cloud services are needed. Once the model download is complete, it can run entirely offline, keeping prompts, code, and diffs on your local machine.

The initial requirement is an M5 Mac with 64GB of RAM. The model is Qwen3.6-27B 4-bit, with a download size of approximately 20GB.

2. Why choose Qwen3.6, not Qwen3.8

JetBrains testing found that with reasoning disabled, Qwen3.6-27B shows minimal loss in task quality while reducing output tokens by two to three times, nearly doubling task execution speed.

Qwen3.8-27B, with reasoning disabled, tends to suffer significant quality degradation—even repeatedly calling the same tool. Enabling medium reasoning increases generated tokens by about five times, making complete tasks nearly four times slower.

Therefore, on current Mac hardware, JetBrains opted for the more balanced Qwen3.6, which offers better speed and stability.

3. Their optimization focus isn’t just decode speed

Coding agents spend much of their time reading project files and processing long prompts; prefill often impacts the user experience more than token-by-token generation.

JetBrains redesigned Junie’s Rolling Context to allow the model to retain previously read files within the context, enabling subsequent tasks to reuse the KV cache without repeated prefilling.

They also reordered the system prompt and project context, allowing more fixed prefixes to be reused across tasks.

4. For local inference, they actively removed some features

Junie Local disables unnecessary LLM calls, such as automatic task summaries.

Multi-agent execution is also turned off, as the most efficient approach on M5 is sequential processing. Launching multiple agents in parallel would still bottleneck at the same inference engine.

This shows that local agents can’t directly replicate cloud workflows—the harness must be redesigned for the hardware.

5. They also implemented several low-level optimizations

4-bit quantization runs about twice as fast as 8-bit in generation.

Optimizing prefill with M5’s 8-bit arithmetic instructions increased throughput by approximately 40%. M5 lacks the same instructions, so prefill is about 20% to 30% slower on M4.

Enabling both MTP and N-gram Speculative Decoding can boost generation speed by up to about two times.

JetBrains reports on internal private benchmarks that the local Qwen3.6-27B with reasoning disabled performs close to Sonnet 4.5 with 10K reasoning tokens enabled, while GPT-5 Medium is slightly higher.

These are the company’s own tests and shouldn’t be taken as universal benchmarks, but they indicate that specifically tuned local models can already handle daily tasks like refactoring, test coverage, dependency upgrades, codebase understanding, and repetitive engineering work.

Currently, Junie Local officially supports only M5 Macs. JetBrains has prototypes for DGX Spark and RTX 5090, and is also exploring 24GB GPUs.

The truly significant trend is now clear.

The competition in local AI coding is shifting from “which model scores higher” to “who can optimize the model, inference engine, KV cache, IDE, and agent loop into a cohesive system.”

The model is just the engine.

The harness and engineering optimizations determine whether it can ultimately get real work done.

Similar Articles

JetBrains local AI (using Qwen3.6 27B)

Reddit r/LocalLLaMA

JetBrains launches Junie Local, an on-device AI coding agent that runs entirely on your Mac using the Qwen3.6 27B model, offering free and private AI assistance without cloud dependency.

Inside JetBrains—the company reshaping how the world writes code

OpenAI Blog

JetBrains, a major IDE provider used by 15M developers globally, is integrating OpenAI models including GPT-5 into its development tools through products like Junie (coding agent) and AI Assistant, focusing on enhancing developer workflows while maintaining code quality and engineering excellence.

@laogui: There are already plenty of GUI wrappers built on top of the Pi Coding Agent, and now JetBrains has open-sourced one called ThinkRail. Coming from the veteran IDE powerhouse, the engineering quality should be solid. This project actually existed a few months ago, but there's been no official promotion, hardly anyone talks about it, and it only has around 500 GitHub Stars...

X AI KOLs Timeline

JetBrains has open-sourced ThinkRail, a lightweight Agentic IDE built on the Pi Coding Agent. It supports Git Worktree-isolated multi-agent parallel development and a Specification-Driven Development (SDD) workflow, complementing the enterprise-grade Air in JetBrains' positioning.

@wsl8297: JetBrains has launched a development environment designed specifically for AI Agents: Air, allowing you to run multiple AI coding agents in parallel without interference. Core concept: Stop waiting for one agent to finish before starting the next. Break down tasks and let multiple agents run simultaneously while you manage and supervise...

X AI KOLs Timeline

JetBrains launched 'Air', a new development environment specifically designed for orchestrating multiple AI coding agents in parallel to handle complex tasks simultaneously without interference.

@wsl8297: Microsoft open-sourced a more convenient VS Code extension: AI Toolkit, which streamlines Agent application development from environment setup to evaluation deployment in one go. A single interface is enough: model selection, Playground trial, Agent building, batch comparison, metric evaluation, all integrated. Gi…

X AI KOLs Timeline

Microsoft open-sourced the VS Code extension AI Toolkit, which integrates model selection, Playground, Agent building, batch testing, and evaluation into one interface, simplifying AI Agent development process.