audio-generation

Tag

Cards List
#audio-generation

@Saccc_c: The hit-or-miss audio problem in AI videos has now been completely solved! No need to keep manually tweaking music in CapCut—you can get audio that perfectly matches your visuals! Since recently starting to experiment with AIGC content, I’ve found that most video models generate audio and visuals together, making the audio difficult to adjust separately and the results inconsistent, which makes post-production edits a real hassle. To address this issue, here’s…

X AI KOLs Timeline ↗ · 2026-10-30 Cached

The user shared an AI video and audio workflow: generate silent visuals with Seedance 2.5, then use Sonilo to create and fine-tune background music and sound effects. This addresses the difficulty of adjusting audio when AI-generated video and audio are bundled together, while also promoting Sonilo’s Halloween membership offer.

0 favorites 0 likes
#audio-generation

Google’s Genie 4 world model adds audio, more realistic worlds, and real-time steering

TechCrunch AI ↗ · 2026-10-27 Cached

Google DeepMind 发布了 Genie 4 世界模型研究预览版,新增实时音频生成、更逼真的可交互世界,以及支持中途提示词编辑的实时操控功能。该模型可维持最长两分钟的场景一致性,并与 Gemini 深度集成,用于机器人仿真、游戏和影视原型制作等场景。

0 favorites 0 likes
#audio-generation

Spatial Audio Generation and Editing with Executable Plans and Self-Distilling Transfusion

Hugging Face Daily Papers ↗ · 2026-10-25 Cached

AMBIT是一个统一框架,通过将自回归场景规划与rectified-flow渲染耦合,实现第一阶Ambisonics(FOA)空间音频的生成与编辑,并利用FOA感知的连续VAE与on-policy自蒸馏来保持空间结构和声学保真度。

0 favorites 0 likes
#audio-generation

inclusionAI/Ming-3.0-TTS-0.5B

Reddit r/LocalLLaMA ↗ · 2026-10-21 Cached

inclusionAI released Ming-3.0-TTS-0.5B, a dense 0.5B multilingual text-to-speech model built on Qwen2.5-0.5B supporting zero-shot voice cloning, voice design, paralinguistic inline tags, and free-form style control across 7 languages plus Chinese dialects.

0 favorites 0 likes
#audio-generation

RubatoCodec: Budgeted Adaptive Speech Tokenization with Streaming Decoding

Hugging Face Daily Papers ↗ · 2026-10-21 Cached

RubatoCodec 提出一种基于固定语句事件预算的自适应语音令牌化方法,结合流式解码,在低事件率下显著提升语音重建质量与可懂度,并在匹配的文本到语音对比中取得更低 WER 与更高 UTMOS 分数。

0 favorites 0 likes
#audio-generation

bread and circuses bench: humanity's true final exam

Reddit r/singularity ↗ · 2026-10-19

作者认为顶级AI实验室近期的短期重点应是让模型具备真实音频能力并在“taste(品味/质量感)”上实现类似Opus 5.5的跃升,从而让人们能自娱自乐,把算力更多用于实际生产力而非处理复杂社交障碍。

0 favorites 0 likes
#audio-generation

Drama3 in audio.cpp: Up to 5× faster than real time at full speed, or 2× real-time speed with < 8 GB of VRAM on an RTX 5090!

Reddit r/LocalLLaMA ↗ · 2026-10-16

Drama3 模型现已支持在 audio.cpp 中运行,在 RTX 5090 上全速运行时最快可达实时速度的 5 倍,或在低于 8 GB 显存下以约 2 倍实时速度运行,仍需进一步优化与修正。

0 favorites 0 likes
#audio-generation

Fish Audio Drama 3

Product Hunt ↗ · 2026-10-14 Cached

Fish Audio 推出其最新 AI 语音模型 Drama 3,支持通过自然语言控制情感、节奏、耳语、笑声和停顿,可生成多角色场景、有声书与游戏对话,覆盖 83 种语言,并以社区许可证开放权重供自托管。

0 favorites 0 likes
#audio-generation

Drama 3 (Website)

TLDR AI ↗ · 2026-10-14 Cached

Fish Audio 发布了 Drama 3 预览版文本转语音模型,支持用自然语言、括号内标签、音效与局部标记来精确指导每一句台词的表演方式,并可通过 API 调用。

0 favorites 0 likes
#audio-generation

@sundarpichai: Argon generated this 3D kinetic typography entirely in code (including the music) without pre-recorded footage or video…

X AI KOLs Timeline ↗ · 2026-10-13 Cached

Sundar Pichai 分享了 Argon 生成的 3D 动态字体作品,全部通过代码生成(包括音乐),无需预录素材或视频编辑软件,每帧都由 3D 网格、粒子模拟等数学算法绘制。

0 favorites 0 likes
#audio-generation

Fish Audio Drama 3 Technical Report

Hugging Face Daily Papers ↗ · 2026-10-13 Cached

Fish Audio 发布开源语音生成模型 Fish Audio Drama 3 的技术报告:基于 35B 参数混合专家骨干(每 token 激活 3B),支持多参考语音克隆、自然语言导演指令、多轮修订、多人场景配音、编辑式填充、长音频与流式合成,单张 H200 推理速度达 271 帧/秒。

0 favorites 0 likes
#audio-generation

Ask HN: Are there AI models for generating sounds based on a text and reference?

Hacker News Top ↗ · 2026-10-05

An Ask HN discussion exploring the gap in commercialized AI models for text + reference audio -> audio generation, noting that while image and text modalities are commoditized, controllable audio generation still lags behind.

0 favorites 0 likes
#audio-generation

@MaximeRivest: wow, this sounds good.

X AI KOLs Following ↗ · 2026-10-02 Cached

A tweet praising ElevenLabs' new Eleven v4 audio model, highlighting a demo ad where the AI voice reads a script listing everything AI voices supposedly 'can't do.'

0 favorites 0 likes
#audio-generation

@rohanpaul_ai: A voice model reading "03/04/27" has to decide whether that's March or April. It decides silently, and the output sound…

X AI KOLs Timeline ↗ · 2026-10-01 Cached

Podonos is launching Onepin, a production-ready voice AI tool that checks each generated line for naturalness and pronunciation, correcting mispronunciations like brand names automatically so a finished voiceover comes out directly from a script.

0 favorites 0 likes
#audio-generation

fishaudio/drama-3

Hugging Face Models Trending ↗ · 2026-10-01 Cached

Fish Audio 发布新一代文本转语音模型 Drama 3,采用 35B 参数 MoE 架构(每 token 激活 3B),支持最多 16 个说话人的多角色长文本生成、语音克隆与自然语言控制,并可在 SGLang-Omni 上流式部署。

0 favorites 0 likes
#audio-generation

Joint and Cross-Modal Video-Audio Generation and Editing: A Unified Formulation and Design Taxonomy

Hugging Face Daily Papers ↗ · 2026-09-28 Cached

A survey paper that unifies joint audio-visual generation, cross-modal generation, and coupled editing into a single formulation over distributions of audio-video pairs, and proposes a taxonomy with five design axes plus nine edit categories covering 28 edit types.

0 favorites 0 likes
#audio-generation

YuE2: Unifying Symbolic and Audio Music Generation at Frontier Quality

Hugging Face Daily Papers ↗ · 2026-09-27 Cached

YuE2 is a unified AI model for symbolic and audio music generation that uses symbolic planning to achieve high-quality results, outperforming previous baselines and competing with proprietary systems like Suno.

0 favorites 0 likes
#audio-generation

@_philschmid: Powered by Gemini 3.8 TTS.

X AI KOLs Timeline ↗ · 2026-09-25 Cached

Gemini Notebook announces that their AI hosts' sound has been updated using Gemini 3.8 TTS, indicating an improvement in text-to-speech capabilities.

0 favorites 0 likes
#audio-generation

Gemini 3.8 text-to-speech says hello

Google DeepMind Blog ↗ · 2026-09-23 Cached

Google introduces Gemini 3.8 Flash TTS and Gemini 3.8 Flash-Lite TTS, new text-to-speech models that enable expressive and customizable audio generation for creators and developers.

0 favorites 0 likes
#audio-generation

@AdinaYakup: HyperFlowNew MiniMax-H3 variant from @video_rebirth - Open weight 8 step LoRA - 3× faster with data free self distillat…

X AI KOLs Timeline ↗ · 2026-09-19 Cached

HyperFlow introduces a new MiniMax-H3 variant with open-weight LoRA that enables 3× faster inference through data-free self-distillation while preserving video and stereo audio outputs.

0 favorites 0 likes
Next →
← Back to home

Submit Feedback