How I'm using local models from real-world coding
Summary
The author shares their experience using local AI models for real-world coding tasks.
Similar Articles
Running local models is good now
The author reports that running local AI models has become surprisingly good, with recent releases like GPT-OSS and Gemma 4 enabling agentic coding locally at about 75% accuracy of frontier models, a significant improvement from just months ago.
Local models went from mostly useless to actually useful really fast. What changed?
The post notes that local AI models have become significantly more useful over the past year, moving from toys to practical tools for coding and workflows, despite still lagging behind closed models for complex tasks.
@TheAhmadOsman: Local AI is the future Learning how to run Opensource models (Inference), how to evaluate them systematically (Evals), …
A tweet from @TheAhmadOsman emphasizes that local AI is the future and recommends learning skills like running open-source models, conducting evals, and customizing models through fine-tuning.
@vboykis: new post: how I develop recently using local models. the tooling is now good enough to do agentic workflows and everyon…
Vicki Boykis shares her experience using local AI models for development, noting that recent releases like Gemma 4 have made agentic workflows feasible locally with about 75% accuracy of frontier models.
Have you ever seriously tried local AI?
The author argues that local AI is underestimated due to usability barriers, and introduces their project Euler to make local AI as seamless as cloud AI with privacy and ownership advantages.