@karpathy: This works really well btw, at the end of your query ask your LLM to "structure your response as HTML", then view the g…

X AI KOLs Following News

Summary

Andrej Karpathy suggests prompting LLMs to structure responses as HTML for better visualization and predicts AI output will evolve from text to interactive neural videos.

This works really well btw, at the end of your query ask your LLM to "structure your response as HTML", then view the generated file in your browser. I've also had some success asking the LLM to present its output as slideshows, etc. More generally, imo audio is the human-preferred input to AIs but vision (images/animations/video) is the preferred output from them. Around a ~third of our brains are a massively parallel processor dedicated to vision, it is the 10-lane superhighway of information into brain. As AI improves, I think we'll see a progression that takes advantage: 1) raw text (hard/effortful to read) 2) markdown (bold, italic, headings, tables, a bit easier on the eyes) <-- current default 3) HTML (still procedural with underlying code, but a lot more flexibility on the graphics, layout, even interactivity) <-- early but forming new good default ...4,5,6,... n) interactive neural videos/simulations Imo the extrapolation (though the technology doesn't exist just yet) ends in some kind of interactive videos generated directly by a diffusion neural net. Many open questions as to how exact/procedural "Software 1.0" artifacts (e.g. interactive simulations) may be woven together with neural artifacts (diffusion grids), but generally something in the direction of the recently viral https://x.com/zan2434/status/2046982383430496444… There are also improvements necessary and pending at the input. Audio nor text nor video alone are not enough, e.g. I feel a need to point/gesture to things on the screen, similar to all the things you would do with a person physically next to you and your computer screen. TLDR The input/output mind meld between humans and AIs is ongoing and there is a lot of work to do and significant progress to be made, way before jumping all the way into neuralink-esque BCIs and all that. For what's worth exploring at the current stage, hot tip try ask for HTML.
Original Article

Similar Articles

@elliotchen100: https://x.com/elliotchen100/status/2054008474082918614

X AI KOLs Timeline

The article analyzes Andrej Karpathy's perspective on using HTML as an output format for LLMs, exploring the evolution of human-computer interaction from a neuroscience viewpoint. The author argues that although the future may shift toward neural simulation, HTML will likely remain a best practice for human-AI collaboration in the near to medium term due to its engineering maintainability and low cost.