Tag
This blog post continues the profiling in PyTorch series, exploring nn.Linear, MLP blocks, and fusion techniques using Triton kernels to optimize performance.
Google's AI strategy is criticized as a surveillance-based profiling engine that forces users into consent through mandatory login, circumventing GDPR. The article exposes Google's plan to replace traditional search with AI-generated answers and personalized tracking, calling it a legal loophole wrapped in AI hype.
This paper finds that human psychometric questionnaires fail to reliably predict LLM behavior in real-world interactions, and proposes generation-based profiling as a more accurate alternative.
A beginner-friendly guide to using PyTorch's torch.profiler for profiling and optimizing neural network operations, starting with matrix multiplication and bias addition. It explains how to read profiler traces and understand CPU/GPU interactions.
Sayak Paul describes a project to profile and optimize Diffusers pipelines using torch.compile, and announces a tutorial series by Ari G. on the topic.
Sensor Tower's engineering team used graph theory analysis and profiling tools to identify bottlenecks in a slow backend endpoint, achieving a fourfold speed improvement by optimizing Protobuf decoding and encoding steps.
This tweet introduces three financial/engineering tools open-sourced by top quantitative institutions such as Jane Street, Goldman Sachs, and J.P. Morgan: magic-trace (high-precision process tracing), gs-quant (Python package for derivatives pricing and risk management), and Perspective (real-time data visualization tool), helping quant enthusiasts gain institutional-level technical capabilities for free.
Accio is a speculative execution framework that reduces cost and latency for web agents by leveraging offline site-structure profiling and online selection of fast paths, achieving a 1.9x reduction in per-task cost and 33.4% latency reduction while maintaining accuracy.
A simple utility to share GPU profile traces using a command-line tool, designed for developers working with GPU profiling.
Python 3.15 introduces the profiling.sampling module, Tachyon, a statistical profiler that periodically samples stack snapshots with minimal overhead, suitable for development and production environments.
A developer shares lessons learned while optimizing Elixir applications, particularly focusing on performance improvements to a Postgres connection pooler (Ultravisor). The article covers profiling techniques using flame graphs, call tracing, and tools like eFlambè and tprof.