Tag
A researcher built software that speeds up quantum circuit design by roughly 10,000×, and GPT-6 Astra further optimized the already-optimized code for an additional ~10× speedup overnight.
A tweet criticizes the optimizations in MLX, suggesting Apple has a software problem rather than a hardware issue, based on performance tests with M5 Ultra Macs.
A discussion questioning the common interpretation of premature optimization in software development, referencing insights from performance expert Casey Muratori.
The article highlights how LLMs make it easy to game performance benchmarks, leading to deceptive software optimization claims, as shown with a regex engine that overfits to benchmarks.
The article argues that the rapid decrease in AI inference costs is driven by software optimizations rather than hardware improvements, and that open-weight models running on consumer GPUs are becoming increasingly competitive with frontier models.
Luce Megakernel demonstrates that NVIDIA's efficiency gap is a software problem, achieving 1.8x throughput on an RTX 3090 compared to llama.cpp and matching Apple M5 Max efficiency at lower cost.