Tag
A tutorial on building a realtime translation app using Gemini Live Translate, Next.js, LiveKit, and Cloud Run, covering audio streaming, translation, and deployment.
Simon Willison updates his OpenAI WebRTC Audio Session tool to support the new GPT-Realtime-2 model and adds document context for conversational audio discussions.
A developer's debugging journey revealing how a WebRTC-based app (p2claw) failed on iPad due to two bugs: a hardcoded constant in webrtc-rs and a one-line design decision in Tailscale, causing data channel message loss.
The author discusses successfully integrating Unity with their project and plans to implement video streaming to a headset, considering WebRTC as a potential solution.
Rtwatch is an open-source Go-based utility that uses Pion WebRTC and GStreamer to enable synchronized, real-time video playback for multiple viewers, with backend-managed state to ensure uniform pause/seek controls.
Technical commentary from Luke Curley discussing how WebRTC's design prioritizes low latency by aggressively dropping audio packets, which conflicts with LLM voice applications where prompt accuracy matters more than speed. He recounts challenges faced at Discord implementing retransmission within browser constraints.
Technical blog post from a self-described WebRTC expert criticizing OpenAI's use of WebRTC for voice AI, arguing the protocol is poorly suited because it's designed for real-time conferencing with aggressive packet dropping, which conflicts with Voice AI use cases where accuracy matters more than minimal latency.
OpenAI details its rearchitected WebRTC stack designed to deliver low-latency voice AI at scale for over 900 million users. The post explains how new split-relay and transceiver architectures optimize media routing and connection setup for real-time interactions like ChatGPT voice.
Raspberry Pi Connect, the free remote access service from Raspberry Pi, may soon support Windows PCs, potentially expanding its reach beyond Raspberry Pi devices and offering a cost-effective alternative to services like RealVNC.