@jerryjliu0: Agreed with this. people underestimate the importance of good abstractions and maintainability. part of the reason LLMs…
Summary
Jerry Liu agrees with Jesse Zhang that people underestimate the importance of good abstractions and maintainability, noting that LLMs are popular partly due to the ease of using them for inference rather than training.
View Cached Full Text
Cached at: 07/14/26, 04:29 PM
Agreed with this. people underestimate the importance of good abstractions and maintainability.
part of the reason LLMs/AI are so popular in the first place is because of the ease of using the models during inference-time (through prompting, orchestration) instead of training
Jesse Zhang (@thejessezhang): I actually feel strongly that the “learning” companies will want to do with their data will mostly not be to train models.
Let’s say you have a bunch of valuable data about your customers or employees.
Your best bet to make that IP useful is to turn it into skills or artifacts
Similar Articles
Quoting Bryan Cantrill
Bryan Cantrill critiques LLMs for lacking the optimization constraint of human laziness, arguing that LLMs will unnecessarily complicate systems rather than improve them, and highlighting how human time limitations drive the development of efficient abstractions.
@rohanpaul_ai: Terence Tao says the math behind today’s LLMs is actually simple. Training and running them mostly uses linear algebra,…
Terence Tao states that the mathematics underlying modern LLMs is simple, using basic linear algebra and calculus, but the unpredictability of model performance across tasks remains a mystery due to the complex nature of natural language data.
@techNmak: I finally found someone who explained why LLM inference is fundamentally different from regular inference… without over…
A tweet shares a link to a clear, accessible explanation of why LLM inference differs from traditional inference, presented in a casual walking video.
@haider1: Yann LeCun says LLMs are strongest in domains where language itself is the substrate of reasoning, like math and code T…
Yann LeCun states that LLMs are strongest in domains where language is the substrate of reasoning, like math and code, but they are not creative mathematicians, software architects, or computer scientists.
@Alacritic_Super: If you want to master LLM inference, start with these three papers. They introduced many of the ideas powering today's …
This thread recommends three key papers for mastering LLM inference: PagedAttention, Sarathi-Serve, and SGLang, which introduce efficient memory management, chunked prefills, and structured generation techniques used in modern inference engines like vLLM and TensorRT-LLM.