computer-use-agent

Fast computer use for AI agents: event-driven settling MCP server - replaces time.sleep between clicks, waits for the UI to react and stop changing, returns the settled screenshot. No blind waits, no wasted vision turns.

Give your AI its own computer. Watch it work through the glass. A VS Code extension: a chat sidebar, a live view of the bot's own sandboxed Linux desktop, and an agent that works with any LLM.

Computer Use Agent Using ADK

real-time visual instructions on your screen

macOS Claude computer-use client. BYOK, on-device, open source. Rust + Tauri + React.

About Mini app where Claude moves the mouse to interact with an HTML page, and uses that interaction to trigger or reflect something in a Flask backend.

A macOS desktop automation agent utilizing a 5-layer cascade (Accessibility Tree extraction to Vision/VLM) driven by cua-driver for robust, cost-effective control.

微信公众号大卫分享

LLM driven computer-use engine that discovers UI workflows, records them as reusable capabilities, and replays them deterministically without an LLM.

A team of AI employees that works on your computer. Prometheus gives you a researcher, an analyst, a writer, an organizer and an operator — and an AI manager who runs them. Tell the manager what you need in one sentence.

mainly extract how codex's “computer use” is and redesign it with powershell and better agent use experience

An open-source agentic framework that enables AI to use computers like humans and can provide a multi-agent runtime environment as an infrastructure capability

Innovative new code that leverages Agents SDK and the computer-use-preview openai api model . The user input a query and the app builds the config and JSON to "visually" search the web for products based on the LLM prompt generated. Test code for proof of concept

SCoR: Sparse Context Reset for Long-Horizon GUI Agents (EMNLP 2026)

The first open-source Artificial Narrow Intelligence generalist agentic framework Computer-Using-Agent that fully operates graphical-user-interfaces (GUIs) by using only natural language. Uses Visualization-of-Thought and Chain-of-Thought reasoning to elicit spatial reasoning and perception, emulates, plans and simulates synthetic HID interactions.

AI Copilot

Can Computer-Use Agents manage buy-side procurement operations? A benchmark across live e-commerce, with multi-model adapters (Northstar, OpenAI, Claude, Gemini), Kernel-hosted browsers, and Harbor/ATIF-v1.6 trajectory export.

AI coding-agent tool routing guide and local TOOLS.md MCP server for Codex, Claude Code, Office/PDF, GitHub, browser automation, and MCP workflows

LLM discovers a legacy banking UI flow once; code replays it deterministically, hands the live session to a human, and governs every capability with a bank-style model-risk lifecycle.

Minimal implementation of Anthropic's Computer Use loop using Kernel browsers