Gui Automation Python Packages

je-auto-control

A framework for GUI automation

openadapt-evals

Windows Agent Arena and GUI-agent evaluation for OpenAdapt. Live support surface. Install the product with pip install openadapt; this repo is the eval harness, including WAA.

je-auto-control-dev

A framework for GUI automation

robotframework-robosapiens

Fully localized Robot Framework library for automating the SAP GUI using text locators

openadapt

Compiles a demonstrated GUI task into a program that reports VERIFIED only if an independent check agrees. pip install openadapt; openadapt flow tutorial. Compiler lives in openadapt-flow.

macos-computer-use-kit

AX-first computer use for AI agents on macOS with optional Jev (TypeSafe System One) semantic guards: calibrated target/input judgments before an irreversible action, decisions kept in code. Accessibility-tree targeting, window-scoped input, clipboard-safe paste, read-back verification. Ships a pip CLI, a pi package and a DeepSeek Harness plugin.

kwin-mcp

MCP server for Linux desktop GUI automation on KDE Plasma 6 Wayland -- 30 tools for virtual and live sessions

qirabot

AI vision GUI automation for browsers, mobile apps, desktops, and games — no DOM, no selectors. Standalone or on top of Playwright / Selenium / Appium / pytest.

pybreeze

PyBreeze features built-in modules tailored for every level of modern automation, allowing developers to tackle complex scenarios without leaving the IDE.

automation-file-dev

JSON-driven file, Drive, and cloud automation framework (dev channel).

pybreeze-dev

PyBreeze features built-in modules tailored for every level of modern automation, allowing developers to tackle complex scenarios without leaving the IDE.

openadapt-capture

Native desktop recorder that keeps screen, input, timing, and window-scoped evidence synchronized.

openadapt-ml

Research. Optional VLM training. Not required to record, compile, or replay. The product is a compiled program (openadapt-flow / pip install openadapt).

automation-ide-dev

PyBreeze features built-in modules tailored for every level of modern automation, allowing developers to tackle complex scenarios without leaving the IDE.

omni-computer-use-mcp

Windows computer-use MCP server - 1:1 replica of Claude Desktop's tool surface, for the Claude Code CLI or any MCP client. Screenshots, mouse, keyboard, multi-monitor. Full tier everywhere: type into IDEs, launch loose dev builds, let the agent test the app you're building.

automation-ide

PyBreeze features built-in modules tailored for every level of modern automation, allowing developers to tackle complex scenarios without leaving the IDE.

oswright

MCP server for Windows desktop automation. Incremental perception instead of a screenshot per step: measured 16.9x fewer tokens per action than the alternatives, with the benchmarks to check it.

anki-addon-workbench

🔬 Headless, disposable-profile testing & cross-platform GUI (screenshot/click) tooling for developing and testing Anki add-ons and decks.

openadapt-desktop

Desktop application for local workflow authoring, operation, evidence review, and governed repair.

pyside6-mcp

Playwright-style MCP server for PySide6 apps — lets Agents see, control, and debug your Python desktop GUI

vnc-remote-control

Layout-aware VNC/RFB remote control CLI: type, key, click, screenshot, OCR, against any VNC/RFB server.

openadapt-agent

Local bridge that exposes governed OpenAdapt workflows to MCP clients and Agent Skills.

axstream

A streaming action language for computer-use agents. LLMs emit one JSON action per line; the executor runs each the moment its newline arrives — while the model is still generating.

wcmd

WCMD 讓你的agent可以控制你的電腦without only using command