Tag
A blog post by Mitchell Hashimoto arguing that SIMD (Single Instruction, Multiple Data) is simpler than often assumed, demonstrating a common pattern for using SIMD in loops with Zig examples.
Nvidia is promoting its new Vera Rubin chip system, which combines GPUs and CPUs, aiming to supply complete AI systems for data centers; OpenAI already has a rack in use.
A detailed technical explanation of how CPU caches work, covering the principle of locality, cache organization, indexing, and handling writes.
A review of the AMD Ryzen 7 7700X3D processor, highlighting its 3D V-Cache technology for improved gaming performance at a lower price point compared to higher-end X3D models.
A user released a BitNet trainer that Microsoft never published, along with custom kernels for training and inference, while also highlighting Microsoft's bitnet.cpp inference framework for fast 1-bit LLM inference on CPUs and GPUs.
cpu.land is a visual explainer that clarifies how CPUs work, multitasking, syscalls, and Linux program loading, aimed at filling knowledge gaps for self-taught programmers.
An analysis of whether AI agents are changing CPU recommendations for consumers.
NVIDIA introduces Vera, a new max single-threaded CPU designed for the agentic AI era, optimizing per-core performance to accelerate AI agent loops and maximize AI factory revenue.
User seeks advice on running llama.cpp with Gemma 4 E2B on an Intel N100 mini PC, asking whether to use CPU or iGPU and which backend to target.
An open-source tool converts PDFs, DOCX, PPTX, XLSX, EPUB, and images to markdown at 122 pages per second, supporting tables, equations, and forms on GPU, CPU, or Mac.
Hugging Face has added a new filter to its Models page that lets users filter by hardware compatibility (GPU, CPU, Apple Silicon), ensuring they only see models that can run on their machine. The filter stacks with other filters and is shareable via URL.
OpenAI co-founder Andrej Karpathy released llm.c, an open-source guide to training LLMs from scratch with simple code that runs on any hardware, including CPUs and MacBooks, and is 7% faster than standard approaches.
Discusses multi-tier caching strategies for MoE models to improve inference speed by keeping frequently activated experts on GPU, referencing existing implementations like PowerInfer and llama.cpp branches.
The author shares progress on building a CPU-only tensor library in C, covering basics like add/mul, reduce, strides, and 2D matmul, along with insights from reading Arcee's technical blogs on foundation models.
A detailed guide on building and understanding the TD4 4-bit DIY CPU kit from Aliexpress, covering soldering, schematics, and operation principles.
Bernstein research report predicts that the era of Agentic AI will drive a reversal of CPU roles in data centers, with the server CPU addressable market possibly reaching $223 billion by 2030, favoring stocks such as Haiguang Information and Arm.
A blog post explaining a counterintuitive optimization where using float division (DIVSD) instead of integer division (IDIVQ) yields faster performance on modern CPUs, with benchmarks and assembly analysis.
NVIDIA introduces the Vera CPU with a neural branch predictor to accelerate agentic AI and reinforcement learning workloads by reducing CPU execution time and increasing throughput in AI factories.
The release of PyLate introduces MaxSim kernels for GPU-accelerated training with lower memory requirements and TACHIOM for fast multi-vector indexing and search on CPU.
TorchCodec 0.14 adds HDR video decoding for CPU and CUDA, along with a fast WAV decoder, enabling efficient conversion of video and audio data into PyTorch tensors for ML workflows.