Tag
WhisperLive is an open-source real-time transcription tool using OpenAI's Whisper, supporting multiple backends like faster-whisper and TensorRT for live speech-to-text.
TurboOCR v3 is a self-hosted, high-speed OCR server that achieves ~520 images per second on an RTX 5090 using PP-OCRv6 models, with new structured parsing for tables and formulas.
This tutorial from NVIDIA walks through the end-to-end workflow of converting an FP8-quantized PyTorch model into a TensorRT inference engine for production deployment, covering ONNX export and performance profiling.
DEMON presents a real-time diffusion engine that enables live musical performance by controlling the denoising process, achieving up to 12.3 decoder completions per second on a single RTX 5090. It introduces heterogeneous scheduling, shared mutable state, per-frame blending, and windowed VAE decode for responsive control.
NVIDIA has officially published a set of Skills for AI agents, covering video analysis, voice agents, LLM training, model acceleration, RAG, secure environments, logistics optimization, and CUDA programming.