# agent-desktop

> CLI for agents to operate apps through the accessibility tree

Worth exploring: After each action, read the interface again and use identifiers from the new snapshot

Checked by Wunderlust: Nov 2026
Can touch: Terminal (runs commands)
Needs: Node.js
Source: Open code on GitHub · Apache-2.0 license
Updated: Nov 2026 · by @vercel-labs

- Category: Agents & dev (`agents`)
- Tags: `open-source`, `cli`, `mcp`
- Official: https://github.com/vercel-labs/agent-desktop
- Wunderlust: https://wunderlust.xyz/r/agent-desktop
- Image: https://wunderlust.xyz/media/agent-desktop-poster.jpg
- Video preview: https://wunderlust.xyz/media/agent-desktop.webm
- Added: 2026-11-18

## What it is

It reads macOS, Windows, and Linux apps and returns elements as JSON with action identifiers. The observe, act, and verify loop lives in the agent, with no model inside the tool.

## What it’s for

Agent developers can use snapshots and identifiers to click or type in desktop apps.

## Benefits

- Actions on accessibility tree elements
- CLI, C library, and MCP server

## Caveats

- Identifiers belong to a snapshot and need to be renewed when the interface changes.

## Similar on Wunderlust

- [OpenCode](https://wunderlust.xyz/r/opencode.md): An open source coding agent for terminal and desktop
- [REA](https://wunderlust.xyz/r/rea.md): A reverse-engineering MCP server and CLI for agents
- [Trail Code](https://wunderlust.xyz/r/trail-code.md): CLI that gives coding agents a repository map and the decisions already made
- [Playwright CLI](https://wunderlust.xyz/r/playwright-cli.md): Playwright's CLI, designed for agents to control the browser using few tokens
- [Agent Browser](https://wunderlust.xyz/r/agent-browser.md): Tool that gives AI agents web browsing
- [CLI-Anything](https://wunderlust.xyz/r/cli-anything.md): Generates CLIs so agents can operate software like GIMP, Blender and LibreOffice
