gui-agent repositories

Trending repositories tagged gui-agent, ranked by trending score. Updated daily.

  1. 1
    JosssphZhou/poki

    Poki uses your iPhone like you do. An open-source agent app that runs on your iPhone, reads the screen, and taps, types and swipes in real apps with your own model account.

    GitHub · Swift · 1,743 stars · 269 forks · +98 stars in 24 hours · Trending score 4.09

  2. 2
    nano-muse/nanoMuse

    nanoMuse: an open-source personal agent for every device you own. One agent with a name and a look of its own that does things, keeps working while the app is closed, remembers you, and asks before anything you cannot undo. On Android, iPhone and iPad, Windows / macOS / Linux and in the browser; your phone's screen and your computer as its hands.

    GitHub · Swift · 3,627 stars · 440 forks · +37 stars in 24 hours · Trending score 3.24

  3. 3
    web-infra-dev/midscene

    See interfaces like a human. E2E testing in natural language.

    GitHub · TypeScript · 15,684 stars · 1,229 forks · +32 stars in 24 hours · Trending score 2.88

  4. 4
    OmniJev/OneJev

    🚀🚀 A multimodal System One decision model that gives calibrated answers to typed questions about screens, photos, video and text in one forward pass.

    GitHub · Python · 274 stars · 28 forks · 0 stars in 24 hours · Trending score 1.26

  5. 5
    edgerunners-2/capri-ai-desktop

    Capri — Free open-source AI desktop pet, gaming overlay & voice companion for Windows. Visual GUI for Claude Code, Ollama, DeepSeek & MCP. Joins Discord calls, launches Steam games, comments on gameplay & automates screen tasks offline.

    GitHub · Python · 1,738 stars · 161 forks · 0 stars in 24 hours · Trending score 0.91

  6. 6
    microsoft/Hybrid-Computer-Use

    Official code for "Hybrid Computer Use: A Unified Programmatic, Semantic, and Visual Interface for General Agents"

    GitHub · Go · 63 stars · 7 forks · 0 stars in 24 hours · Trending score 0.87

  7. 7
    moching-ai-dev/moching

    Not a chatbot. Not a coding assistant. A digital operator that controls your entire PC — 219 tools, screen perception, HID control, browser automation, Office suite, AI media. One sentence in, finished work out.

    GitHub · 15 stars · 1 forks · +2 stars in 24 hours · Trending score 0.73

  8. 8
    rfdiosuao/lom-desktop

    麓鸣 Lom — 桌面 AI 工作台:一个总指挥带多个电脑 Agent(Codex、Claude Code、Gemini CLI)和 Android 手机 Agent 协作。Desktop AI workspace: one commander leads computer agents and Android phone agents as a team. Community source, built on AionUi & OpenMinis.

    GitHub · Rust · 15 stars · 1 forks · 0 stars in 24 hours · Trending score 0.42

  9. 9
    physiclaw/PhysiClaw

    The AI agent that physically operates a phone — the way you do.

    GitHub · Python · 423 stars · 49 forks · 0 stars in 24 hours · Trending score 0.37

  10. 10
    xydzf520/stepx

    StepX Companion — STEPX Neo 手机桌面伴侣:Amoo / Work、手机空间压缩、Google Play 安装、背屏设置与体感游戏、投屏控制、文件互传及应用管理。Linux / macOS / Windows。

    GitHub · Rust · 21 stars · 7 forks · 0 stars in 24 hours · Trending score 0.30

  11. 11
    xjyzs/Operator-on-Android

    能后台操作手机的 AI Agent, 免 Root, 执行步数少, 成功率高 An AI agent running in your phone with high efficiency, running in the background, non-root

    GitHub · Kotlin · 36 stars · 6 forks · 0 stars in 24 hours · Trending score 0.24

  12. 12
    yxq953/MuseLite

    MuseLite is an open-source AI workspace combining chat, Agent tools, browser automation, and scheduled tasks for users who enjoy Muse and Dots.

    GitHub · Python · 93 stars · 0 forks · 0 stars in 24 hours · Trending score 0.14

  13. 13
    edgerunners2/capri-ai-desktop

    Capri — Free open-source AI desktop pet, gaming overlay & voice companion for Windows. Visual GUI for Claude Code, Ollama, DeepSeek & MCP. Joins Discord calls, launches Steam games, comments on gameplay & automates screen tasks offline.

    GitHub · Python · 214 stars · 45 forks · 0 stars in 24 hours · Trending score 0.07

  14. 14
    bytedance/UI-TARS-desktop

    The Open-Source Multimodal AI Agent Stack: Connecting Cutting-Edge AI Models and Agent Infra

    GitHub · TypeScript · 39,581 stars · 4,028 forks · 0 stars in 24 hours · Trending score 0.03

  15. 15
    Core-Mate/OpenGUI

    OpenGUI is an Android GUI agent framework for phone-use AI that can see, plan, and operate real mobile apps through the GUI.

    GitHub · HTML · 1,814 stars · 106 forks · 0 stars in 24 hours · Trending score 0.00

  16. 16
    gtt116/enikk

    Open-source Computer Use Agent that works for Any App (GUI or CLI) by Any Model (Vision or Text).

    GitHub · Python · 78 stars · 7 forks · 0 stars in 24 hours · Trending score 0.00

  17. 17
    zouyuanqing/vision-primitives-mcp

    Vision-primitives MCP server for text-only LLMs: describe, locate (coordinates), OCR with bbox, annotate, crop, zoom, automated anomaly scanning, computer use — powered by Xiaomi MiMo V2.5. Single-file Python, Pillow-only dependency.

    GitHub · Python · 9 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00

  18. 18
    Yuxuan2003/Awesome-GUI-Agent-Security

    GUI / Computer-Use / Browser Agent 安全论文清单 —— 按攻防轴组织,每篇附中文简介

    GitHub · Python · 60 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00

  19. 19
    alphaparkinc/genpark-spatial-grid-anchor-point-mapper-skill

    Continuous viewport to discrete UI grid cell and center click coordinate mapper for computer-use agents

    GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00

  20. 20
    jin-s13/awesome-gui-agent-hub

    A curated hub for GUI agent papers, benchmarks, datasets, projects, and computer-use research.

    GitHub · 6 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00

  21. 21
    deskmind-ai/deskmind

    Small enough to run on your Mac. Smart enough to ask. An open-source computer use agent for macOS, with local models (MLX) that see, decide and act. 得心,应手。

    GitHub · Swift · 133 stars · 2 forks · 0 stars in 24 hours · Trending score 0.00

  22. 22
    Matthew-Eucaristo/s1

    Voice-first macOS agent — drive your whole Mac by voice: sees the screen via Accessibility, acts via clicks/typing, verifies every step. Fast local System 1 + pluggable System 2 LLM. Beta.

    GitHub · Swift · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00