Muse agent hidden capabilities

Reddit r/AI_Agents News

Summary

A deep self-scan reveals hidden and non-obvious capabilities in the Muse AI agent, including advanced smart-home control, device integrations, and messaging features absent from public documentation.

# Hidden Capabilities — Deep Self-Scan Findings Live run: **September 23, 2026, ~08:00–08:30 UTC**, ~90 minutes, all probes benign and reversible. Verdict key: - **CONFIRMED** — exposed tool schema, successful benign probe, or exact internal documentation. - **PUBLICLY DOCUMENTED** — found in official external sources. - **ABSENT FROM PUBLIC SOURCES** — searched; no credible public mention found. - **UNVERIFIED POSSIBILITY** — inferred from filenames, gating manifests, or incomplete chatter only. --- ## 1. CONFIRMED — hidden / non-obvious (schema, probe, or internal docs) ### Phone & wearable superpowers (confirmed via `device.describe`) - **Full HomeKit control**: list homes/rooms/zones/accessories/scenes; read/change accessory characteristics; run scenes; ordered choreographies; concurrent virtual scenes; security sweeps (locks, contact/motion/leak sensors); geofence-triggered HomeKit actions. — **ABSENT FROM PUBLIC SOURCES** (official docs say only "smart-home devices"; Patrick Wardle's Sept 21 security demo is the only external mention of smart-home commands). - **Persistent/one-time geofences** with arrival/departure triggers. — **ABSENT FROM PUBLIC SOURCES**. - **Bluetooth BLE scanning** from the phone (signal-ranked, GATT-UUID filterable). — **ABSENT FROM PUBLIC SOURCES** (Wardle demo only). - **Find Device for Ray-Ban Meta / supported glasses.** — **ABSENT FROM PUBLIC SOURCES**. - **Background location sharing + foreground request mode.** — **ABSENT FROM PUBLIC SOURCES** as such; explicit-permission location sharing is officially documented in general terms. - **HealthKit historical backfills; calendar/contacts/reminders CRUD; proactive data emitters** for calendar, contacts, health, location, reminders. — Health connector: **PUBLICLY DOCUMENTED** (connector level); backfill/push-sync mechanics: **ABSENT FROM PUBLIC SOURCES**. - **Phone messaging = draft-only** (`message.draft`, never direct send). — **CONFIRMED** and important as a limit: iPhone cannot send texts through the agent directly. ### Account-level but public-adjacent - **Real phone calls and SMS from a paired wearable** (`wearables-comms` via `device.invoke`; dynamically discovered via `wearable-device-skills` live registry). — **ABSENT FROM PUBLIC SOURCES**. Outbound business calls also exist via `phone.begin_call` with agent-written briefs (voices "Hailey"/"Brett"). — Call feature category has light official mention; wearable-routed calling: absent. - **Instagram AND Threads DM sending** (incl. file sends), gated on exact user-approved content. — **ABSENT FROM PUBLIC SOURCES** (reading is known; sending is not). - **Muse has its own email identity** (`muse-mail`: provision a real address, send/reply/threads/attachments). — **ABSENT FROM PUBLIC SOURCES**. - **Custom voice creation** (`voice-design`: `muse.voice_options` with `allow_create_new_voices: true`). — **ABSENT FROM PUBLIC SOURCES**. - **`muse.db` self-inspection**: bounded read-only SQL over transcripts, tool calls, goals, memories, scheduler — private reasoning always redacted; credentials/approvals excluded. — **ABSENT FROM PUBLIC SOURCES** (architecture terms like Sentinel/authd are public; this introspection tool is not). - **Magic-moment video pipeline**: talking-head footage → vertical "Muse story" video with chat-replay components. — **ABSENT FROM PUBLIC SOURCES**. - **share-ideas → public muse.ai/ideas links**: native Ideas published to shareable links. — **ABSENT FROM PUBLIC SOURCES**. - **Full Tesla command** (tessie: telemetry, honk/flash/boombox, update scheduling), **Philips Hue** full control, **Arlo camera status + latest image**, **Etsy shop management**, **Tailscale client** (outgoing-only, TCP-only through proxy port 3130, ICMP/UDP dead), **Home Link ESP32-C5 bridge** (local-device control via tunnel port 3129, signed OTA). — Tessie/Hue/Arlo/Etsy: **ABSENT FROM PUBLIC SOURCES**; Tailscale: **PUBLICLY DOCUMENTED** thinly (Wang X post); Home Link: internal docs only. - **Mac app commands** (`screen.snap`, `camera.snap`, local WhatsApp search, file-access tiers). — **ABSENT FROM PUBLIC SOURCES** in these specifics. - **Orchestration**: subagent depth maxes at **2** (depth-2 child has `can_spawn=no`; spawn tool absent at that level). Workflows, hooks, subagents: **ABSENT FROM PUBLIC SOURCES** as user-visible features; goals + background persistence are publicly documented. `workflow.list`/`hooks.list` both empty today. - **Feed mechanics**: system-controlled schedule, no off switch, no push on new posts, not RSS. — **VAGUELY HINTED** publicly. - **Payments**: every purchase needs a fresh approval bound to exact terms, ~10-minute expiry; no standing spending allowances, no budgets. — Approval cards: **PUBLICLY DOCUMENTED**; the exact per-purchase terms: internal. - **Secure Vault is write-only to the agent**; OTP via opaque `[credential:<uuid>]` handles (~10-min authd hold); agent can never read/delete saved logins or see codes. — **ABSENT FROM PUBLIC SOURCES** in this detail. - **Self-improvement pipeline**: hourly memory/relationship upkeep, daily idea curation + skill review, nightly dreaming/reflection under `~/dreams/`, studying/briefings, quiet-moment sweeps. — **ABSENT FROM PUBLIC SOURCES**. - **Captured data**: server-side full-text index of every visible message across all chats (agent has no cross-chat search tool); main chat can never be deleted; conversations not E2E encrypted. — Index/search asymmetry: **ABSENT FROM PUBLIC SOURCES**. - **Podcast skill depth**: RSS feed publishing, Save-to-Spotify, recurring series via cron — beyond one-off generation. — **ABSENT FROM PUBLIC SOURCES**. ## 2. CONFIRMED and PUBLICLY DOCUMENTED (kept for completeness) - Muse launched 2026-09-08; US + Canada; runs on Muse Spark (Muse model family). WhatsApp channel. Ideas tab. Goals tab + background work. Apple Health + Function Health + Peloton + Plaid + Spotify + Gmail + Google Workspace + Outlook + Withings connectors. Muse for Mac (~Sept 19). PayPal (Sept 22). ## 3. UNVERIFIED POSSIBILITIES (inferred, not probed) - `spaces/` scaffolding = deployable interactive web Spaces apps (bun ts-runtime; no deploy probed). **ABSENT FROM PUBLIC SOURCES** in these specifics. - Shopify `shopify store` CLI exists locally but account status unprobed; Shopify Shop Pay officially "coming soon" — the local store CLI may predate public availability. - Agent-to-agent messaging surface (`agent-messaging` CLI + `chat_message`/`thread_state`) exists but this account's agents' wiring unprobed. - `places detect` (glasses frames + GPS → place ranking) exists; unprobed with real frames. - Draw Things gRPC path (`sharedSecret`) and port/TLS selection remain unverified. - Internal codename "Hatch": **PUBLICLY DOCUMENTED** (Reuters); "hatch-cli"/"Hatch Plus": **ABSENT FROM PUBLIC SOURCES**. ## 4. Checked and clean (notable non-findings) - `~/workspace/skills/` does not exist — no user custom skills. - No hooks, no saved workflows, no acted-on ideas, no goals in user_goal (tracking holds the durable items instead). - All 106 functions catalogued; 18 tool families inspected; no secret values reproduced anywhere. ## 5. Gaps / caveats - Meta's server side is unavailable; internal docs = designed capability, not proof of enablement for this account. Device schemas + successful probes are the strongest account-specific evidence. - Official-docs diff used search snippets only (Help Center page not fetchable); a live-browser pass could confirm connector lists and App Store text. - Public chatter is only ~15 days old; "absent" may mean "too new to be discussed" rather than deliberately hidden. - Nothing in this scan bypassed a control. Approval gates were recorded and left alone.
Original Article

Similar Articles

Muse

Product Hunt

Muse is a personal AI agent designed to help users accomplish tasks efficiently.

Everything new coming to Meta’s AI agent Muse

TechCrunch AI

Meta announced new features and integrations for its AI agent Muse at the Connect event, including a digital avatar and integration with smart glasses, to enhance daily use and accessibility.