Ran a 0.9B transcribe + diarize model on a 17.5 minute, 4 person AMI meeting on a MacBook: all 4 speakers found, 0.08% speaker confusion, done in 12 minutes

Reddit r/LocalLLaMA Models

Summary

作者在 MacBook Pro (M5 Pro, 64GB) 上用 MPS 后端运行 0.9B 的 MOSS-Transcribe-Diarize 模型,对 AMI 测试集一段 17.5 分钟、4 人会议做单次转写+说话人分离,仅用 12 分钟(约 0.68x 实时)完成,4 位说话人全部识别,说话人混淆率仅 0.08%,DER 为 15.4%,并能正确处理重叠对话。

Wanted to see how one model that does transcription, speaker labels and timestamps in a single pass handles a real meeting, so I ran MOSS-Transcribe-Diarize 0.9B on a four person meeting from the AMI test set and scored its speaker turns against AMI's reference. Setup: 17:29 of AMI headset mix audio with four speakers (diarizers-community/ami, test split, row 12; AMI is CC BY 4.0). Their README's transformers code, fp32, sdpa attention, greedy decoding, no hotwords, no VAD, nothing else in the pipeline. M5 Pro MacBook Pro with 64 GB, running on the GPU through mps (on a Mac, set the device to "mps" yourself). It took 714 s for the 1,049 s file, about 0.68x real time, and it found all four speakers. The labels are the standout: with the usual 0.25 s collar and the best speaker mapping, speaker confusion was 0.08%, so when it writes a line, it's attributed to the right person almost every time. Overall DER at that collar was 15.4%. It also handles people talking over each other. 87 of its 317 segments start before the previous one ends, and every one of those is a different speaker, so interruptions come out as overlapping lines with both people labeled. First few lines of raw output, untouched: [10.88][S01]Are we we're not allowed to dim the lights so people can see that a bit better.[14.56] [17.86][S02]Yeah.[18.21] [18.84][S01]Okay, that's fine.[20.28] [22.31][S01]Am I supposed to be standing up there?[23.76] [25.08][S03]So we've got both of these clipped on.[26.56] [29.04][S03]Is she gonna answer me or not?[30.24] [29.84][S01]Yeah, I've got.[30.44] This is one meeting, scored on who and when, since that's what the AMI reference I used covers. If anyone has pyannote 3.1 plus Whisper numbers on the AMI test meetings on Apple silicon, I'd like to see DER and runtime on the same files.
Original Article

Similar Articles

@YichiZ03: https://x.com/YichiZ03/status/2078588932191895976

X AI KOLs Timeline

MOSS-TD, a speaker-aware ASR system, is optimized within the SGLang-Omni serving stack, enabling 38-minute multi-speaker audio to be transcribed in about 49 seconds on a single H100, with concurrent processing of 16 meetings.

An hour of audio transcribed in about 13s on MacBook Air

Hacker News Top

Google's EmbeddingGemma 2 embedding model has been repurposed into a speech-to-text tool that transcribes an hour of audio in about 13 seconds entirely on-device on a base MacBook Air, using a small trained reader on top of the frozen audio encoder.