gui-automation repositories

Trending repositories tagged gui-automation, ranked by trending score. Updated daily.

  1. 1
    momasiku/dsh-pilot

    DeepSeek Harness 的桌面自动化:给整台 Windows 机器装上眼睛和手。可以做人能做的任何事,包括且不仅限于CAD,WPS,浏览器操作,发微信。安全,快速,可靠,聪明,人性化。

    GitHub · JavaScript · 212 stars · 14 forks · +71 stars in 24 hours · Trending score 3.18

  2. 2
    Anionex/dsh-vision-toolkit

    [dsh]为纯文本模型设计更强大的视觉工具箱:一行安装使用、粘贴图片直接识别、多张图片问答、截图到前端UI 还原等|DeepSeek Harness-native integration for agent-vision-toolkit: image Q&A, long-screenshot OCR, UI restoration, grounding, pixel diff, Artifacts, and Web UI.

    GitHub · TypeScript · 950 stars · 49 forks · +32 stars in 24 hours · Trending score 2.56

  3. 3
    Anionex/dsh-computer-use

    为 DeepSeek Harness 提供电脑控制插件:新鲜 Accessibility 观测、过期状态拒绝、作用域权限与安全输入(目前支持macos)|Accessibility-first macOS Computer Use bundle for DSH with fresh observations, stale-state rejection, scoped permissions, and safe input.

    GitHub · TypeScript · 109 stars · 8 forks · +34 stars in 24 hours · Trending score 2.44

  4. 4
    iFurySt/open-computer-use

    👾 Open Computer Use – Open-Source Alternative to Codex Computer Use

    GitHub · Swift · 3,039 stars · 281 forks · +12 stars in 24 hours · Trending score 2.40

  5. 5
    moeru-ai/auv

    📱🐭 Are we computer use, I guess not, it's Application Use Via... a unified orchestration layer of OS automation, 0 token cost. Supports Linux, macOS, Windows, offering TypeScript / Rust / Python / Go SDK

    GitHub · Rust · 223 stars · 20 forks · +21 stars in 24 hours · Trending score 2.29

  6. 6
    wq19901103wq/wechat-mac-rpa

    基于多模态视觉感知与 LLM Agent 的 macOS 微信自动化框架 | Visual RPA for WeChat

    GitHub · Python · 152 stars · 46 forks · +14 stars in 24 hours · Trending score 2.09

  7. 7
    OpenAdaptAI/OpenAdapt

    For EHRs, payer portals, and any app your team clicks through. A person or an agent shows the task; OpenAdapt turns it into a local program that repeats the steps with no model calls, checks each save, and stops when something doesn't match.

    GitHub · Python · 1,894 stars · 286 forks · +3 stars in 24 hours · Trending score 1.57

  8. 8
    isac322/kwin-mcp

    MCP server for Linux desktop GUI automation on KDE Plasma 6 Wayland — 29 tools for virtual and live sessions

    GitHub · Python · 84 stars · 27 forks · +7 stars in 24 hours · Trending score 1.56

  9. 9
    Joy-word/AutoXiaoer

    A friend on your phone.

    GitHub · Kotlin · 35 stars · 5 forks · +8 stars in 24 hours · Trending score 1.45

  10. 10
    munimtechnologies/munim-computer-use

    Open-source Computer Use MCP server for any coding agent — macOS, Windows, Linux. Accessibility-first, background input, agent pointer, zoom, your signed-in Chrome.

    GitHub · Rust · 43 stars · 9 forks · +2 stars in 24 hours · Trending score 1.07

  11. 11
    jcpsimmons/jev-macos-loop

    Open-source macOS AI computer use and native GUI automation on Apple silicon. Jev + OmniParser CoreML + Apple Vision OCR. Bring your own OpenRouter, Vercel AI Gateway, or TypesafeAI token.

    GitHub · JavaScript · 27 stars · 0 forks · +4 stars in 24 hours · Trending score 1.06

  12. 12
    microsoft/Hybrid-Computer-Use

    Official code for "Hybrid Computer Use: A Unified Programmatic, Semantic, and Visual Interface for General Agents"

    GitHub · Go · 63 stars · 7 forks · 0 stars in 24 hours · Trending score 0.86

  13. 13
    qirabot/qirabot

    AI vision GUI automation for browsers, mobile apps, desktops, and games — no DOM, no selectors. Standalone or on top of Playwright / Selenium / Appium / pytest.

    GitHub · Python · 20 stars · 3 forks · +2 stars in 24 hours · Trending score 0.72

  14. 14
    rpdg/winput

    Windows backend input automation library in Go (Message + HID). A Go wrapper over Interception for reliable Windows input automation. 基于内核驱动级的 Windows RPA 自动化 输入注入库

    GitHub · Go · 26 stars · 7 forks · +1 stars in 24 hours · Trending score 0.64

  15. 15
    AmrDab/clawdcursor

    Local MCP server that gives any AI agent safe desktop control on Windows, macOS and Linux. Reads the screen as text and structure (accessibility + OCR) and acts by element name, with screenshots as the last resort. Multi-monitor aware, verifies every action, one safety gate.

    GitHub · TypeScript · 407 stars · 59 forks · +1 stars in 24 hours · Trending score 0.41

  16. 16
    Jeffrey-Automations/AutoControlGUI

    A framework for GUI automation

    GitHub · Python · 61 stars · 3 forks · 0 stars in 24 hours · Trending score 0.20

  17. 17
    imbus/robotframework-robosapiens

    Fully localized Robot Framework library for automating the SAP GUI using text locators

    GitHub · Python · 56 stars · 4 forks · 0 stars in 24 hours · Trending score 0.14

  18. 18
    Ar9av/clippy

    Clippy rebuilt as a macOS agent that can use your computer. It reads your screen and clicks/types the thing

    GitHub · Swift · 12 stars · 0 forks · 0 stars in 24 hours · Trending score 0.10

  19. 19
    Jeffrey-Automations/PyBreeze

    PyBreeze features built-in modules tailored for every level of modern automation, allowing developers to tackle complex scenarios without leaving the IDE.

    GitHub · Python · 65 stars · 3 forks · 0 stars in 24 hours · Trending score 0.08

  20. 20
    ltmroberthk915/dsh-computer-use

    The most precise Windows computer use for DeepSeek Harness: 19 tools address controls by exact UI Automation identity, and numbered marks are checked against the live window before input, so a stale target is refused instead of mis-clicked. Batches, incremental observations and compact receipts cut round trips and token cost.

    GitHub · JavaScript · 6 stars · 0 forks · 0 stars in 24 hours · Trending score 0.08

  21. 21
    Core-Mate/OpenGUI

    OpenGUI is an Android GUI agent framework for phone-use AI that can see, plan, and operate real mobile apps through the GUI.

    GitHub · HTML · 1,814 stars · 106 forks · −5 stars in 24 hours · Trending score 0.06

  22. 22
    Fhaxikii/Nano-Lumen

    Nano-Lumen is resident general-purpose agent for Windows desktop, designed as a persistent-state system: cross-session, crash-recoverable, local-first privacy. (Beta)

    GitHub · Python · 6 stars · 0 forks · 0 stars in 24 hours · Trending score 0.04

  23. 23
    myna-recorder/Myna-Macro-Recorder-Auto-Clicker

    Myna Recorder — a Windows macro recorder you can read and edit. Image anchors, an auto clicker, an AI assistant that writes macros, Agent mode (computer use, for short jobs) and a screen watchdog.

    GitHub · 29 stars · 0 forks · −32 stars in 24 hours · Trending score 0.01

  24. 24
    aiwaki/makc

    No-cgo mouse and keyboard control for Go on Windows, macOS, and Linux.

    GitHub · Go · 13 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00