Tag
A summary of William Brandon's (performance engineer at Anthropic) GPU programming fundamentals lecture, emphasizing that understanding the streaming multiprocessor (SM) structure of GPU hardware is key to predicting performance, rather than starting solely from the software abstraction of thread blocks/threads.
A detailed thread summarizing the book 'Programming Massively Parallel Processors', focusing on CUDA and GPU programming concepts, optimization techniques, and parallel patterns.
The article introduces core concepts from the book "Systems Performance" regarding latency, throughput, cache hierarchies, etc., and references latency numbers from experts like Jeff Dean, emphasizing the importance of hands-on practice for performance engineering.
Anthropic engineer Tristan Hume discusses the challenges of designing AI-resistant technical take-home tests for hiring performance engineers, detailing how recent Claude models have begun to outperform human candidates.