Cua: Open-Source Infrastructure for Computer-Use AI Agents Across Desktop Operating Systems
By
frabonacci
An everything bagel for the brain. Substantive, layered, well-seasoned.
Summary
Cua is an open-source infrastructure project for building and running Computer-Use Agents — AI agents that can control full desktops across macOS, Linux, and Windows. The project provides sandboxes, SDKs, and benchmarks for training and evaluating these agents. Key features include a Cua Driver for background computer-use on macOS that allows agents to interact with native apps without stealing cursor focus, and agent-ready sandboxes for multiple operating systems. The tool supports CLI and MCP server integration with Claude Code, Cursor, and custom clients, and records sessions as replayable trajectories.
Key quotes
· 4 pulledDrive any native macOS app in the background — agents click, type, and verify without stealing the cursor, focus, or Space, even on non-AX surfaces like Chromium web content and canvas-based tools (Blender, Figma, DAWs, game engines).
Use with the CLI or MCP server for Claude Code, Cursor, and custom clients.
Every session records as a replayable trajectory.
Open-source infrastructure for Computer-Use Agents. Sandboxes, SDKs, and benchmarks to train and evaluate AI agents that can control full desktops (macOS, Linux, Windows).
You might also wanna read
Open Computer Use: Open-Source Desktop Automation Tool for AI Agents via MCP
Open Computer Use is an open-source tool that turns local desktop automation into a standard MCP (Model Context Protocol) service. It allows
Cursor 3: Unified Workspace for Parallel Local and Cloud AI Agents in Software Development
Cursor 3 is a unified workspace platform designed for software development with AI agents, featuring parallel local and cloud agent capabili
CUStats: Real-time AI Usage Monitoring Tool for Claude and OpenAI Codex Across macOS, iOS, and Android
CUStats is a monitoring tool that tracks AI service usage (Claude and OpenAI Codex) across macOS, iOS, and Android platforms. The tool provi
Orca: Open-Source Desktop App for Parallel AI Agent Development
Orca is a free, open-source desktop application that enables parallel AI agent development by combining Ghostty-style terminals, git worktre
Cai: Free macOS tool runs AI prompts and scripts with ⌥C keystroke, no cloud required
Cai is a free, MIT-licensed macOS tool that lets users press ⌥C on any text to trigger smart actions like AI prompts, shell scripts, GitHub
1Code: Parallel Claude Code Agent Runner for Mac and Web
1Code is an application that enables running multiple Claude Code AI agents in parallel, available for both Mac (local execution with or wit
