Tag
Engineers are losing grip on their systems due to rapid delivery and higher-order abstractions, which speed up happy paths but prolong failure paths without enough discussion.
The article explains the efficient frontier concept in LLM inference, covering tradeoffs between latency, throughput, and cost, and outlines techniques to manage or enhance efficiency in deployment.
Software fundamentals remain crucial when working with AI agents because tradeoffs like latency, consistency, and cost must be managed. Expertise involves understanding these tradeoffs and guiding agents to make appropriate choices for a system.
The article argues that software engineering is primarily about managing complexity through architectural decisions and tradeoffs, with AI being effective at code generation but not at handling these higher-level aspects. It highlights how building software involves critical choices about constraints, costs, and evolution beyond mere syntax.
A detailed technical analysis of PostgreSQL's MVCC design, its known drawbacks like write amplification and vacuum overhead, and a comparison to alternatives that shows all database engines face similar fundamental trade-offs.
A technical exploration of stateless actors in Swift, discussing their uses, trade-offs, and comparisons with structs using concurrent functions, including examples like network clients and background actors.
This paper studies when end-to-end reinforcement learning training improves multi-agent LLM workflows, comparing shared-policy and isolated-policy training across different workflows, tasks, and model scales, revealing conditional tradeoffs.
A developer tested adding 'think step by step' to a customer support AI agent, achieving a 3% accuracy gain but with a 40% latency increase and doubled costs, concluding that the net impact was negative and highlighting the importance of measuring production tradeoffs.