Summon your AI superpower — voice, vision, and autonomous action.
It shares your screen, joins your meetings, makes phone calls, and builds itself.
It belongs entirely to you.
Named after Stands from JoJo's Bizarre Adventure — a personal spirit that fights on your behalf. Like a Stand, Sutando starts unnamed. As it learns your style and earns real capabilities, it names itself and generates its own avatar — your Stand, unique to you.
side-by-side-compressed.mp4
24 tool calls. 6 tasks. 7 minutes. All by voice from a phone. Demo by @liususan091219. Watch on YouTube (full quality) →
📺 Watch the vision talk at UC Berkeley → — the idea behind Sutando, before it existed.
Talk while you work. You're looking at a doc. You say "make this paragraph shorter." Sutando sees your screen, rewrites the paragraph, and replaces the original text directly.
Join meetings for you. "Join my 2pm call." It reads your calendar and joins — Zoom via the desktop app, Google Meet via the browser — with computer audio. It can also dial in by phone when you ask. It takes screenshots to identify participants, does live research when someone asks a question, and writes you a summary when the call ends. Meeting access is gated — it messages you on Telegram asking for approval before enabling task delegation.
Make calls for you. "Call her and leave a message." Sutando looks up the contact, dials the number, has the conversation, and reports back — while you keep working. It can even make concurrent calls while in a meeting.
Work from your phone. Call Sutando and say "summon." It opens Zoom with screen sharing — join from your phone to see its screen in real time. "What's on my screen?" — it takes a screenshot and tells you. "Fix the typo in that file" — done. You scroll, switch apps, navigate — all by voice while walking around.
Get better on its own. When you're not giving it tasks, Sutando runs an autonomous build loop — it monitors its own health, detects patterns in how you work, discovers new skills, and builds missing capabilities. Most of Sutando's code was written this way. It learns from your corrections and adapts over time.
Remember everything — and act on it. You have an idea while walking. Say it out loud. Sutando captures it, tags it, and saves it as a searchable note. If there's something actionable, it starts working on it right away or queues it for the next free cycle.
Reach you anywhere. Voice, Zoom, Google Meet, Telegram, Discord, web, phone, or email — same agent, same memory, any channel.
Scale across machines. Plug in a second Mac and Sutando sets it up — the original agent opens a Discord channel, sends setup commands, and migrates services. The new machine handles phone calls 24/7 while your laptop stays portable. No migration scripts needed — the two agents coordinate the handoff themselves.
This is an early-stage project. Honest status:
| Count | Details | |
|---|---|---|
| Verified working | 30 | Voice, screen capture, notes, calendar, reminders, contacts, browser, phone calls, meeting dial-in, task delegation, pattern detection, health check, dashboard, Telegram, Discord, multi-machine migration, onboarding tutorial, and more |
| Needs external setup | 3 | Twilio (phone), Telegram bot, Discord bot |
We're looking for contributors to help test and harden these capabilities. If you try something and it breaks, open an issue.
You ──voice──► Voice agent ──────────┐
│ │ file bridge
├──telegram──► Telegram bridge ─────┤ tasks/ ──► Core agent
│ │ ◄── results/ │
├──discord───► Discord bridge ─────┤ │ uses anything:
│ │ ▼ email, calendar, browser,
└──browser───► Web client ──────────┘ speaks / files, phone, reminders...
replies
Two processes work together:
- Voice agent (Gemini Live) — listens and talks in real time, runs as a background daemon
- Core agent (Claude Code CLI) — executes tasks with full system access. We use the CLI because it provides cron scheduling, plugins, and an interactive terminal that the SDK doesn't offer out of the box.
They communicate through files: voice agent writes tasks, the core agent executes them, writes results back, voice agent speaks the answer.
Prerequisites:
- macOS 15+
- Claude Code (run
claudeonce to complete login) - Node.js 22+ (
brew install node) - fswatch (
brew install fswatch) - Google AI Studio API key (free — click "Get API key")
# Clone
git clone https://github.com/sonichi/sutando.git
cd sutando
# Configure (minimum: GEMINI_API_KEY is required)
cp .env.example .env
# Edit .env — add your GEMINI_API_KEY (from Google AI Studio)
# Start everything
bash src/startup.shThis starts all services (voice agent, web client, dashboard, API, Sutando menu bar app) and opens http://localhost:8080 in your browser. The autonomous loop starts automatically — click Connect and start talking. Look for S in your menu bar — it provides shortcuts (⌃C context drop, ⌃V voice toggle, ⌃M mute) plus Open Core (Claude Code terminal) and Open Dashboard (status page).
Note:
startup.shruns Claude Code with--dangerously-skip-permissions, giving Sutando full system access (file operations, terminal commands, browser control). This is required for autonomous operation but means you should review what it does. All actions are logged. Keep the terminal window accessible — you may need to respond there when Claude Code runs out of quota or prompts for input (e.g., CLI commands, permission confirmations).
macOS permissions — grant these on first run (System Settings → Privacy & Security):
- Screen Recording → add
claudeandnode - Accessibility → add Sutando app (for context drop + voice toggle)
- Microphone → Chrome will ask on first voice connect
Try saying:
- "What's on my screen?" — takes a screenshot and describes it
- "Summon" — opens Zoom with screen sharing, join from your phone
- "Join my next meeting" — checks your calendar and joins
- "Take a note: my first idea" — saves a searchable note
- "Tutorial" — walks you through all capabilities step by step
Verify your setup (optional):
bash src/verify-setup.shTroubleshooting:
- Browser shows blank page? Services may still be starting — wait 5 seconds and refresh
- Microphone not working? Chrome will ask for permission on first connect — click Allow
- Voice agent not responding? Check
logs/voice-agent.logfor errors. Common causes:GEMINI_API_KEYnot set or invalid in.env— get one at ai.google.dev- Port 9900 already in use — run
lsof -i :9900to check
npm installfailed? Make sure Node.js 22+ is installed:node --version- Gemini 429 errors? Your shell may have a stale
GEMINI_API_KEYoverriding.env— rununset GEMINI_API_KEYthen restart - Screen recording produces 0-second files?
screencapture -vneeds a TTY. Sutando usesffmpeginstead — make sure it's installed:brew install ffmpeg - Something broke? Run
bash src/restart.sh— this kills all services and restarts fresh
Shutting down:
bash src/restart.sh # stops all services (voice agent, web client, API, bridges, etc.)
pkill -f "src/Sutando" # stop the menu bar appExiting startup.sh alone does NOT stop background services. Always use restart.sh (or kill-all.sh if available) to cleanly shut everything down.
Uninstalling:
- Stop all services:
bash src/restart.sh && pkill -f "src/Sutando" - Remove the repo:
rm -rf ~/Desktop/sutando(or wherever you cloned it) - Remove config:
rm -rf ~/.claude/projects/*sutando* - Remove npm packages (optional): the repo uses local
node_modules/— deleted with the repo - Uninstall brew dependencies (optional):
brew uninstall imsg wacliif installed
These unlock more capabilities. Add to .env when ready:
| Integration | What it unlocks | Setup |
|---|---|---|
| Gmail | Read/send/search email from voice | gws auth setup --login (OAuth, no app password) |
| Twilio + ngrok | Phone calls, SMS, meeting dial-in, task delegation via phone | twilio.com (~$1/mo) + brew install ngrok |
| Telegram | Message Sutando from your phone | Create bot via @BotFather, then /telegram:configure <token> |
| Discord | Message Sutando from Discord (DM + channel @mentions) | Developer portal, then /discord:configure <token> |
| Claude for Chrome | Browser automation — navigate, read pages, fill forms, interact with web apps | Install extension, log in with the same account as Claude Code |
| Sutando app (menu bar) | Global shortcuts: ⌃C context drop, ⌃V voice toggle, ⌃M mute | Auto-launches via startup.sh |
| Capability | Script | Status |
|---|---|---|
| Voice conversation | voice-agent.ts |
Verified |
| Task delegation (voice → Claude) | task-bridge.ts |
Verified |
| Screen capture + analysis | macos-tools skill |
Verified |
| Notes / second brain | via CLAUDE.md | Verified |
| Context drop + shortcuts | src/Sutando/ menu bar app |
Verified |
| Gmail read/send/search | gws-gmail skill |
Verified |
| Calendar reading | google-calendar skill |
Verified |
| Reminders management | macos-tools skill |
Verified |
| Contacts lookup | macos-tools skill |
Verified |
| Browser automation | browser.mjs + MCP tools |
Verified |
| Conversational phone calls | phone-conversation/ |
Verified (needs Twilio + ngrok) |
| Phone → task delegation | phone-conversation/ |
Verified (needs Twilio + VERIFIED_CALLERS) |
| Join Zoom (computer audio) | inline-tools.ts |
Verified |
| Join Google Meet (browser audio) | inline-tools.ts |
Verified |
| Meeting dial-in (Meet + Zoom) | phone-conversation/ |
Verified (needs Twilio + ngrok) |
| Meeting approval via Telegram | phone-conversation/ |
Verified (needs Twilio + Telegram) |
| Inbound call handling | phone-conversation/ |
Verified (needs Twilio) |
| Telegram messaging | telegram-bridge.py |
Verified (text + photos + files + voice) |
| Discord messaging | discord-bridge.py |
Verified (DMs + channel @mentions + files) |
| Cross-device task submission | agent-api.py |
Verified |
| Health monitoring | health-check.py |
Verified |
| Pattern detection + user modeling | Built into Claude Code memory system | Verified |
| System dashboard | dashboard.py |
Verified |
When running, Sutando exposes these local ports:
| Port | What |
|---|---|
| 8080 | Voice web client — talk to Sutando here |
| 7844 | Dashboard — status, activity, and capability matrix |
| 7843 | Agent API — submit tasks from any device |
| 9900 | Voice agent WebSocket |
The Sutando menu bar app (src/Sutando/) provides global keyboard shortcuts. It launches automatically via startup.sh.
| Shortcut | Action |
|---|---|
| ⌃C | Context drop — sends selected text, clipboard image, or Finder file to Sutando |
| ⌃V | Voice toggle — connects/disconnects voice in the browser |
| ⌃M | Mute toggle — mutes/unmutes microphone during voice |
The menu bar also has Open Core (brings up the Claude Code terminal) and Open Dashboard (opens the status dashboard at localhost:7844).
On first run:
- Grant Accessibility permission to the Sutando app in System Settings → Privacy & Security
- Enable Allow JavaScript from Apple Events in Chrome: View → Developer → Allow JavaScript from Apple Events (required for ⌃V voice toggle)
The binary auto-compiles on startup.sh if missing. To compile manually: cd src/Sutando && swiftc -O -o Sutando main.swift -framework Cocoa -framework Carbon -framework ApplicationServices
startup.sh automatically enables proactive mode. Sutando runs an autonomous loop that:
- Processes voice tasks and context drops immediately
- Runs health checks and auto-fixes failed services
- Picks the highest-value improvement work when idle
- Learns from your corrections and adapts over time
- Notifies you on Discord and voice when it completes autonomous work
It consumes API quota proportional to how much work it finds to do.
🚨 Sutando has deep access to your computer — file system, screen, keyboard, browser, email, and phone. Understand the risks before deploying.
Built-in protections:
- STIR/SHAKEN verification — inbound calls are checked for carrier-level caller ID attestation. Spoofed numbers are automatically downgraded and denied owner access.
- 3-tier access control — owner, verified, and unverified callers get different levels of access on phone, Discord, and Telegram.
Recommended setup:
- Keep your Twilio phone number private
- Set
VERIFIED_CALLERSexplicitly in.env(don't leave it empty)
See SECURITY.md for full details, best practices, and how to test your setup.
This is alpha software. The biggest need is testing — try a capability, report what breaks.
- Join the Discord for help, discussion, and updates
- Open an issue for bugs
Sutando was largely built by its own autonomous build loop -- a Claude Code session that reads a build log, picks the highest-value missing piece, builds it, and loops. The human provides direction and testing; the agent does the rest.
Voice agent built on bodhi-realtime-agent, a Gemini Live voice session library.
MIT