gui-automation repositories
Trending repositories tagged gui-automation, ranked by trending score. Updated daily.
-
1
momasiku/dsh-pilot
DeepSeek Harness 的桌面自动化:给整台 Windows 机器装上眼睛和手。可以做人能做的任何事,包括且不仅限于CAD,WPS,浏览器操作,发微信。安全,快速,可靠,聪明,人性化。
GitHub · JavaScript · 212 stars · 14 forks · +71 stars in 24 hours · Trending score 3.18
-
2
Anionex/dsh-vision-toolkit
[dsh]为纯文本模型设计更强大的视觉工具箱:一行安装使用、粘贴图片直接识别、多张图片问答、截图到前端UI 还原等|DeepSeek Harness-native integration for agent-vision-toolkit: image Q&A, long-screenshot OCR, UI restoration, grounding, pixel diff, Artifacts, and Web UI.
GitHub · TypeScript · 950 stars · 49 forks · +32 stars in 24 hours · Trending score 2.56
-
3
Anionex/dsh-computer-use
为 DeepSeek Harness 提供电脑控制插件:新鲜 Accessibility 观测、过期状态拒绝、作用域权限与安全输入(目前支持macos)|Accessibility-first macOS Computer Use bundle for DSH with fresh observations, stale-state rejection, scoped permissions, and safe input.
GitHub · TypeScript · 109 stars · 8 forks · +34 stars in 24 hours · Trending score 2.44
-
4
iFurySt/open-computer-use
👾 Open Computer Use – Open-Source Alternative to Codex Computer Use
GitHub · Swift · 3,039 stars · 281 forks · +12 stars in 24 hours · Trending score 2.40
-
5
moeru-ai/auv
📱🐭 Are we computer use, I guess not, it's Application Use Via... a unified orchestration layer of OS automation, 0 token cost. Supports Linux, macOS, Windows, offering TypeScript / Rust / Python / Go SDK
GitHub · Rust · 223 stars · 20 forks · +21 stars in 24 hours · Trending score 2.29
-
6
wq19901103wq/wechat-mac-rpa
基于多模态视觉感知与 LLM Agent 的 macOS 微信自动化框架 | Visual RPA for WeChat
GitHub · Python · 152 stars · 46 forks · +14 stars in 24 hours · Trending score 2.09
-
7
OpenAdaptAI/OpenAdapt
For EHRs, payer portals, and any app your team clicks through. A person or an agent shows the task; OpenAdapt turns it into a local program that repeats the steps with no model calls, checks each save, and stops when something doesn't match.
GitHub · Python · 1,894 stars · 286 forks · +3 stars in 24 hours · Trending score 1.57
-
8
isac322/kwin-mcp
MCP server for Linux desktop GUI automation on KDE Plasma 6 Wayland — 29 tools for virtual and live sessions
GitHub · Python · 84 stars · 27 forks · +7 stars in 24 hours · Trending score 1.56
-
9
Joy-word/AutoXiaoer
A friend on your phone.
GitHub · Kotlin · 35 stars · 5 forks · +8 stars in 24 hours · Trending score 1.45
-
10
munimtechnologies/munim-computer-use
Open-source Computer Use MCP server for any coding agent — macOS, Windows, Linux. Accessibility-first, background input, agent pointer, zoom, your signed-in Chrome.
GitHub · Rust · 43 stars · 9 forks · +2 stars in 24 hours · Trending score 1.07
-
11
jcpsimmons/jev-macos-loop
Open-source macOS AI computer use and native GUI automation on Apple silicon. Jev + OmniParser CoreML + Apple Vision OCR. Bring your own OpenRouter, Vercel AI Gateway, or TypesafeAI token.
GitHub · JavaScript · 27 stars · 0 forks · +4 stars in 24 hours · Trending score 1.06
-
12
microsoft/Hybrid-Computer-Use
Official code for "Hybrid Computer Use: A Unified Programmatic, Semantic, and Visual Interface for General Agents"
GitHub · Go · 63 stars · 7 forks · 0 stars in 24 hours · Trending score 0.86
-
13
qirabot/qirabot
AI vision GUI automation for browsers, mobile apps, desktops, and games — no DOM, no selectors. Standalone or on top of Playwright / Selenium / Appium / pytest.
GitHub · Python · 20 stars · 3 forks · +2 stars in 24 hours · Trending score 0.72
-
14
rpdg/winput
Windows backend input automation library in Go (Message + HID). A Go wrapper over Interception for reliable Windows input automation. 基于内核驱动级的 Windows RPA 自动化 输入注入库
GitHub · Go · 26 stars · 7 forks · +1 stars in 24 hours · Trending score 0.64
-
15
AmrDab/clawdcursor
Local MCP server that gives any AI agent safe desktop control on Windows, macOS and Linux. Reads the screen as text and structure (accessibility + OCR) and acts by element name, with screenshots as the last resort. Multi-monitor aware, verifies every action, one safety gate.
GitHub · TypeScript · 407 stars · 59 forks · +1 stars in 24 hours · Trending score 0.41
-
16
Jeffrey-Automations/AutoControlGUI
A framework for GUI automation
GitHub · Python · 61 stars · 3 forks · 0 stars in 24 hours · Trending score 0.20
-
17
imbus/robotframework-robosapiens
Fully localized Robot Framework library for automating the SAP GUI using text locators
GitHub · Python · 56 stars · 4 forks · 0 stars in 24 hours · Trending score 0.14
-
18
Ar9av/clippy
Clippy rebuilt as a macOS agent that can use your computer. It reads your screen and clicks/types the thing
GitHub · Swift · 12 stars · 0 forks · 0 stars in 24 hours · Trending score 0.10
-
19
Jeffrey-Automations/PyBreeze
PyBreeze features built-in modules tailored for every level of modern automation, allowing developers to tackle complex scenarios without leaving the IDE.
GitHub · Python · 65 stars · 3 forks · 0 stars in 24 hours · Trending score 0.08
-
20
ltmroberthk915/dsh-computer-use
The most precise Windows computer use for DeepSeek Harness: 19 tools address controls by exact UI Automation identity, and numbered marks are checked against the live window before input, so a stale target is refused instead of mis-clicked. Batches, incremental observations and compact receipts cut round trips and token cost.
GitHub · JavaScript · 6 stars · 0 forks · 0 stars in 24 hours · Trending score 0.08
-
21
Core-Mate/OpenGUI
OpenGUI is an Android GUI agent framework for phone-use AI that can see, plan, and operate real mobile apps through the GUI.
GitHub · HTML · 1,814 stars · 106 forks · −5 stars in 24 hours · Trending score 0.06
-
22
Fhaxikii/Nano-Lumen
Nano-Lumen is resident general-purpose agent for Windows desktop, designed as a persistent-state system: cross-session, crash-recoverable, local-first privacy. (Beta)
GitHub · Python · 6 stars · 0 forks · 0 stars in 24 hours · Trending score 0.04
-
23
myna-recorder/Myna-Macro-Recorder-Auto-Clicker
Myna Recorder — a Windows macro recorder you can read and edit. Image anchors, an auto clicker, an AI assistant that writes macros, Agent mode (computer use, for short jobs) and a screen watchdog.
GitHub · 29 stars · 0 forks · −32 stars in 24 hours · Trending score 0.01
-
24
aiwaki/makc
No-cgo mouse and keyboard control for Go on Windows, macOS, and Linux.
GitHub · Go · 13 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00