@MinLiBuilds: A new cost-effective benchmark has appeared with Qwen3.8-27B. AA Index 52.0 score, ranking 108/137 models in capability. If the price is cheaper than theirs, it's a local kill line. The local cost formula is simple: Cost per Token = (Total machine price + 3-year electricity cost) ÷ 3-year total output Tokens…

X AI KOLs Timeline Models

Summary

The Qwen3.8-27B model is presented as a cost-effective locally deployed AI model, with cost analysis showing it significantly outperforms cloud models like Opus in both performance and cost, emphasizing the economic benefits of local inference.

A new cost-effective benchmark has appeared with Qwen3.8-27B. AA Index 52.0 score, ranking 108/137 models in capability. If the price is cheaper than theirs, it's a local cost-effective threshold. The local cost formula is simple: Cost per Token = (Total machine price + 3-year electricity cost) ÷ 3-year total output Tokens 3-year total output Tokens = 26280 hours × utilization rate × 3600 seconds × throughput per second. The only variable that truly determines cost is the utilization rate. Cost is fixed, the more you use it, the cheaper it gets. The following numbers are pure speculation, based on values the community might achieve, and won't affect the viewing effect. Let's calculate with an RTX 5090: Total machine cost: 35,000 RMB, 27B 4-bit quantization, high concurrency total throughput at 800 tok/s, electricity price 0.6 RMB, 3-year depreciation. If you only run it 2.4 hours per day, which is 10% utilization: Output Tokens equivalent to $0.697 / million Tokens. Assuming Opus 4.6 still exists, referencing Opus 5's price. 36 times cheaper than Opus 4.6. Run it 4.8 hours per day: $0.356 / million Tokens. 70 times cheaper. Here's the key point. If you run the 5090 as a service, with utilization at 70%: Over 3 years, it can output 53 billion Tokens, with a total cost of about 42,000 RMB. Without considering the concurrency limitations of no KV Cache, and not accounting for throughput losses due to batch decreases as context length increases. Selling at the price of the cheapest cloud model in the same tier, the theoretical gross margin is 91%, and it pays back in about 72 days at full load. Of course, this is just a theoretical value. So, to be even more aggressive: If you only run it 2.4 hours per day, running locally is still about 18 times cheaper than Opus 4.6. This is what's truly terrifying about the 27B Dense model: It's already strong enough. But the Token cost is starting to be in a different league. Thread2 has more parameter comparisons. On DGX Spark, the experience is completely different. Once you send a task, you might have to stare at a blank screen for a long time before seeing the first character of the answer. The entire task also takes a long time to complete. This is no longer interactive inference; it's more like batch processing. So, machines like DGX Spark with large unified memory but relatively limited bandwidth are actually better suited for MoE models like Ling-3-Flash. The total parameters can be huge, but each Token activates far fewer parameters. Just because a Dense model can fit doesn't mean it's suitable to run. Being able to run and running smoothly are two different things. If you want to see how to deploy MoE or Dense models locally step by step, and the detailed steps for integrating Claude Code, see below.
Original Article
View Cached Full Text

Cached at: 08/19/26, 12:35 AM

A new performance threshold has emerged with Qwen3.8-27B.

Scoring 52.0 on the AA Index, it dominates 108 out of 137 models on the capability leaderboard.

If priced lower than competitors, it becomes an on-the-spot cost killer.

The local cost formula is just one line:

Cost per Token = (Total system price + 3-year electricity cost) ÷ Total Tokens produced over 3 years

Total Tokens over 3 years = 26,280 hours × Utilization rate × 3,600 seconds × Tokens per second throughput.

The single variable that truly determines cost: utilization rate.

With fixed costs, higher usage means cheaper per-token economics.

The following figures are pure speculation, extrapolated based on values the community might realistically achieve—doesn’t affect the viewing experience.

Taking an RTX 5090 as an example:

Full system cost: 35,000 RMB, running 27B 4-bit quantized, high-concurrency total throughput at 800 tok/s, electricity at 0.6 RMB/kWh, with 3-year depreciation.

If used only 2.4 hours per day (10% utilization):

Output cost equivalent to $0.697 per million tokens.

Assuming Opus 4.6 is still available, referencing Opus 5’s pricing.

That’s 36 times cheaper than Opus 4.6.

If used 4.8 hours per day:

$0.356 per million tokens.

70 times cheaper.

Here’s the key point.

If you run the 5090 as a service with 70% utilization:

It can output 53 billion tokens over 3 years, total cost around 42,000 RMB.

This doesn’t account for concurrency limits without KV cache, nor throughput losses from longer contexts causing batch size reductions.

Selling at the price of the cheapest comparable cloud model, theoretical gross margin reaches 91%, paying back in about 72 days under full load.

Of course, this is just theoretical.

To push it further:

Even at just 2.4 hours daily usage, local deployment remains about 18 times cheaper than Opus 4.6.

This is the truly terrifying part about 27B Dense models:

They’re already powerful enough.

But token costs? They’re not even in the same league anymore.

Thread2 contains more parameter comparisons.

The experience on DGX Spark is a completely different story.

After sending a task, you might stare at a blank screen for ages before seeing the first answer character.

The entire task takes forever to complete.

This is no longer interactive reasoning—it’s more like batch processing.

So machines like DGX Spark, with massive unified memory but relatively limited bandwidth, are actually better suited for MoE models like Ling-3-Flash.

Total parameters can be huge, but the actual parameters activated per token are far fewer.

Just because you can fit a Dense model in doesn’t mean it’s suitable for running.

Being able to run it versus running it smoothly are two different things.

If you want to see how to deploy MoE or Dense models locally step-by-step, along with detailed instructions for integrating Claude Code, see below.

When machine costs are fixed, amortizing them over 3 years means the more you use it, the more tokens you produce, and the cheaper the amortized cost becomes.

The harder you use it, the faster you recover the investment.

Here are some theoretical values for reference, excluding infrastructure-related investments.

Previously in construction, I specialized in calculating infrastructure electricity costs.

Dario and Sam’s trillion-dollar valuations are about to be challenged.

I’ve done performance evaluations before, you can check those out.

Prices went up again? I was still thinking 26,000 per card.

Just inquired about a dual-card system today, a bit scared—the seller said they’d give me a quote tomorrow.

Nice, dual cards allow self-sufficiency. With a proper workflow, you can generate unlimited videos for free.

Similar Articles

Qwen 3.8 27b is out. Big news for local AI

Reddit r/ArtificialInteligence

Qwen 3.8 27b, a sub-30 billion parameter AI model, has been released and is suitable for local inference on consumer hardware like RTX 3090 or M4 Pro, potentially replacing cloud-based AI subscriptions and shifting workflows locally.

@Xudong07452910: A hot comment section on Hacker News: Qwen 3.6 27B is the ideal choice for local development. Key findings: dense parameter model, native support for 256k context, running Q8_0 quantized version at 30 tokens/…

X AI KOLs Timeline

Qwen 3.6 27B is a dense 27B model that achieves impressive performance on local hardware with 256k context, running at 30 tokens/s on MacBook Max M5 and 50 tokens/s on RTX 5090, and is considered by some as the first local model with true general intelligence.

@zhixianio: After receiving the new machine, I began an 'ascetic' practice of forcing myself to use local models for common tasks. I thought it would be painful, but both speed and quality greatly exceeded my expectations: Model: Qwen3.6-35B-A3B-oQ6-fp16-mtp, Running: oMLX, with N…

X AI KOLs Timeline

The author uses the Qwen3.6-35B-A3B model and oMLX tool on the new local machine for daily tasks, finding that both speed and quality far exceed expectations, even outperforming remote LLMs in PA and coding scenarios, demonstrating a significant improvement in on-device AI capabilities.

Qwen 3.7 Max

Reddit r/LocalLLaMA

Qwen 3.7 is an impressive new AI model from Chinese labs, with discussion on whether weights will be available for download.