Tag
Astra is an AI model capable of identifying sounds from mel spectrograms using zero-shot learning, with potential for further exploration.
AirCaps Audio Research Lab launches with streaming speech and audio models designed for complex real-world environments, claiming superior performance on edge hardware compared to leading cloud models.
Nemotron-3-Diarization is an open-weight speaker diarization model by NVIDIA for real-world audio analysis, supporting streaming and offline inference up to eight speakers with commercial use permitted.
StemDeck is a free, open-source local AI tool for separating audio into stems like vocals and drums, offering a DAW-style mixer without uploads or subscriptions.
The article argues that EasyEffects, a Linux audio processing tool using PipeWire and plug-ins, should be integrated into all Linux distributions to significantly improve laptop speaker sound quality through software tuning.
A public instance of Muscriptor, the latest and most powerful Audio-to-MIDI model, is available to convert any song into piano MIDI using GPU acceleration.
A new streaming voice conversion model, MeanVC2, has been released, supporting cross-gender and cross-language conversion with real-time performance on CPU.
audio.cpp release 0.6 introduces new audio models including dots.tts and MiniMax-H3, along with a native WebUI and performance improvements for text-to-audio and music generation.
A video demonstrates a GUI front end experiment that uses the Skred sound engine as an audio effects processor, with a design inspired by the Korg DW-8000 digital delay line. The project is MIT-licensed open source on GitHub.
A GitHub project that uses FFmpeg to simulate cassette tape audio profiles including tape noise, wow/flutter, bandwidth limits, and equalizer adjustments. Provides scripts for different cassette types.
Microsoft released vibevoice, a 7B model that transcribes up to an hour of audio in one shot with built-in speaker diarization and timestamps, supporting 50+ languages and running locally without API costs.
MOSS-TD, a speaker-aware ASR system, is optimized within the SGLang-Omni serving stack, enabling 38-minute multi-speaker audio to be transcribed in about 49 seconds on a single H100, with concurrent processing of 16 meetings.
Inkling, a 975B Mixture-of-Experts model (41B active) with 1M context and Apache-2.0 license, introduces a novel audio front end using a 7.9M parameter lookup table instead of a traditional encoder, achieving strong performance on speech tasks. The model was pretrained on 45 trillion tokens of text, images, audio, and video.
A browser-based tool that converts singing voice into printable musical notation, with adjustable parameters for pitch tolerance, noise gate, and note splitting sensitivity.
Mirelo AI, in collaboration with Kyutai Labs, introduces an open-source Audio-to-MIDI model that transcribes full music mixes into separate MIDI tracks per instrument, detecting chords, key, and tempo directly from the mix without requiring isolated stems.
MuScriptor is an open-source model for multi-instrument music transcription, capable of transcribing recordings into MIDI notes for each instrument without prior knowledge of the instruments present.
UniSE is a unified, prompt-free, autoregressive speech enhancement model based on a decoder-only language model, supporting multiple tasks like speech restoration, target speaker extraction, and speech separation in a single model.
A technical blog post describing the development of a real-time system that follows a drummer by estimating tempo and phase from drum hits using a phase-locked loop, enabling the software to adapt to human feel instead of forcing the drummer to follow a machine.
A study from OrukLabs shows that speech models trained solely on transcription or masked audio tasks spontaneously learn to represent emotions in their deeper layers, as revealed by mapping with real voice clips.
audio.cpp releases a major update adding music/SFX generation and source separation with ACE-Step, HeartMuLa, Stable Audio 3, and HTDemucs, achieving up to 10x real-time speed for long music generation in native C++/GGML.