Rosply: An AI Agent That Autonomously Controls Your Computer Screen and Performs Tasks
By
Harkixsha
Summary
Rosply is an AI agent that autonomously controls a computer by seeing the screen, moving the mouse, clicking, and typing. It was built by a solo maker out of curiosity about whether AI could use a computer like a human. The tool features a vision system, persistent memory, loop detection, and works across Windows, Mac, and Linux. It integrates with Claude Code and MCP for developer workflows, and supports any vision-capable model via OpenRouter, avoiding vendor lock-in.
Source
Product HuntRosply: An AI Agent That Autonomously Controls Your Computer Screen and Performs Tasksproducthunt.comKey quotes
· 3 pulledHonestly, Rosply started out of boredom.
I wanted to build something, and I got curious about whether an AI could actually use a computer the way a person does, not just answer questions in a chat window, but see the screen, move the mouse, click, type, and get real things done.
adding persistent memory so it does not forget context between steps, loop detection so it knows when it is stuck instead of repeating the same mistake forever
You might also wanna read
agent-desktop: A Rust-based CLI for AI-driven desktop automation via OS accessibility trees
agent-desktop is a native desktop automation CLI built with Rust, designed specifically for AI agents to control desktop applications throug
GitHub·1mo ago
OpenClaw: Open-Source AI Agent Raises Security Concerns While Automating Tasks
OpenClaw is an open-source AI agent that runs locally on users' computers and performs practical tasks like managing reminders, writing emai
The Verge·4mo ago
Microsoft announces Autopilot AI agents starting with Scout, moving beyond Copilot assistance
Microsoft announced a new category of agentic AI called "Autopilot" at Microsoft Build, starting with its first agent, Scout. Unlike Copilot
theregister.com·17d agoMicrosoft announces Autopilot AI agents starting with Scout, moving beyond Copilot assistance
Microsoft announced a new category of agentic AI called "Autopilot" at Microsoft Build, starting with its first agent, Scout. Unlike Copilot
theregister.com·17d ago
AI Team OS: Multi-Agent Operating System for Autonomous Claude Code Development
AI Team OS is a multi-agent team operating system for Claude Code that transforms the AI coding assistant into an autonomous, self-driving A
github.com·3mo ago
PycoClaw: Full OpenClaw AI Agent Implementation for $5 Microcontrollers Using MicroPython
PycoClaw is an open-source project that brings full OpenClaw AI agent functionality to embedded hardware, specifically $5 microcontrollers.
pycoclaw.com·3mo ago
Anthropic's Claude AI Gains Computer Control Capabilities for Automated Tasks
Anthropic has introduced new autonomous capabilities for its Claude AI assistant that allow it to control users' computers to perform tasks
The Verge·3mo agoComments
Sign in to join the conversation.
No comments yet. Be the first.