I spent 45 minutes driving to work every day unable to talk to my AI agent, so I built an iOS app where I can handsfree talk to my AI agent - with full TTS and STT built-in
A developer built ClawVibe, an iOS app for hands-free voice interaction with AI agents, featuring on-device speech recognition and TTS for low latency.
Every morning I drive 45 minutes to work. I have an AI agent I use for planning, task management, and thinking out loud, and I couldn't use it at all during that commute. The phone-in-hand solutions weren't going to work while driving. The web UI needed tapping. So, I started building something just for myself. That was two months ago. What I ended up with is ClawVibe, a native iOS voice assistant that talks to your AI agent, completely hands-free. The problems I ran into (and why the app works the way it does) My first version streamed voice audio over the mobile network to a server for transcription. In theory, fine. In practice, latency spikes, packet loss on patchy mobile signal, the whole thing falling apart mid-sentence. I realised the core mistake: audio is a huge amount of data to push over a mobile connection reliably. Text isn't. So, I moved everything on device. The speech recognition happens on the phone. The text-to-speech happens on the phone. The only thing that ever travels over the network is the transcript, a handful of characters. Latency dropped. Packet loss became irrelevant. It even works in areas with barely any reception. Moving on device created its own problem. Most ML models want to use Apple's Metal framework (GPU acceleration) which is fast. But Apple doesn't allow Metal processes to run in the background. So as soon as the screen went off, the model would stall. I had to switch to standard CoreML without GPU acceleration to keep it running in the background while driving. Trade-off worth making. The other thing I kept hitting was background noise. GPS directions. Someone talking nearby. A radio. All of it was getting picked up and sent to the AI as if I'd said it. The fix was voice biometrics; the app now learns your voice profile and only sends audio it recognises as you. GPS can announce a turn and the AI ignores it. What I built: * On-device speech recognition: transcribed on the phone, never sent to Apple or Google. Only the text goes to your AI. * On-device TTS: multiple voice options, spoken back through the phone or CarPlay speakers. * Always-on voice detection: no button, no wake word. It knows when you're talking. * CarPlay: full hands-free in the car. The original reason I built it. * Primary voice recognition: option for only your registered voice to trigger the AI. Background voices and sounds are ignored. * GPS context: location data sent with every message for location-aware responses. Where it's at: In TestFlight beta now, and I am looking for beta testers. It will be free on the App Store after beta testing and once it clears review. The free version gives you the full core voice experience. A Premium tier is coming with a whole range of value-added features: more voices, multiple voice profiles, expanded CarPlay UI, Apple Watch support, and more. You will need your own AI backend to connect it to, it supports a few different setups, and more integrations are in progress. If you already run your own OpenClaw instance, you're good. If you don't have your own AI server set up yet, you can still trial the app with a local on-device model. If you're into self-hosted AI, privacy-first tools, or just want hands-free AI in your car, I'd love feedback. What would make this useful for you, or what would stop you from using it? And which AI system would you want to connect it to?
A developer created a way for AI agents to control real iPhones via API, enabling tasks like drafting iMessages, running iOS Shortcuts, and mobile app testing. They are offering access to 70 phones for experimentation.
A full-time SWE built an AI assistant that works via iMessage/SMS, activating a private AWS server per user to perform tasks like building apps, making websites, and planning vacations. It's free for testing.
A developer built OpenClaw Voice, a dedicated voice interface using Home Assistant Voice PE and OpenAI Realtime, enabling sub-second smart home control, memory-based queries, phone calling, and long-running tasks with voice feedback. The entire stack is open-sourced.
The author built callitdone.today, an AI voice agent that makes real phone calls, navigates IVR menus, waits on hold, and speaks with humans, sharing key technical challenges and lessons learned.