Tag
A tweet or post discussing the concept of reinventing BlackBerry using first principles thinking, focusing on fundamental technology and design concepts.
An NVIDIA intern shares insights from research on how frontier LLMs should perform inference on heterogeneous systems, with a thread containing TLDR and mini experiments.
An in-depth educational article explaining networking and the internet from first principles, covering packet switching, TCP, DNS, TLS, and how data travels across the globe.
This paper proposes a mathematical formulation of slow thinking and active perception, introducing a theory called 'active lifting' that derives design, training, and inference processes for slow thinking large language models.
A recommendation to examine winning harnesses from the ARC AGI challenge to understand effective first-principles design and avoid overfitting to benchmarks.
Jensen Huang shares how he maintained conviction during Nvidia's early struggles, emphasizing first principles reasoning and intellectual honesty.
This article introduces nine thinking tools summarized in the book "The Musk Principle," including first principles thinking, the five-step algorithm, the idiot index, etc., aimed at helping young people master Musk's way of thinking and apply it to work and life.
Elon Musk shares his 5-step algorithm for engineering problem-solving, emphasizing questioning requirements, deleting unnecessary steps, then optimizing, speeding up, and automating.
The author strongly criticizes the concept of an infinite canvas, arguing that the essence of AI video is horizontally arranged film strips, and announces a complete refactoring from first principles before release.
A GitHub repository that teaches how to build AI agents from first principles using local LLMs and node-llama-cpp, progressing from basic LLM interactions to full agent architectures like ReAct.
A technical blog post that explains how to build agent training systems from first principles using a text-to-diagram agent as an example, covering environment definition, teacher trajectory generation, student fine-tuning, and reinforcement learning.
Three college students used first principles to design a purely mechanical hearing aid costing only $19.99. Customized via AI and 3D printing, it requires no battery or circuitry, and has the potential to make hearing assistance affordable for hundreds of millions worldwide.
The author criticizes the ease of using high-level libraries like PyTorch without understanding underlying mechanics, recommending Simon J.D. Prince's notebooks to bridge the gap between syntax and first-principles engineering.
A personal reflection on first principles thinking versus reasoning by analogy, using examples from Elon Musk's approach to reducing rocket costs at SpaceX, and the author's own startup failure.