dsh-desktop-automation
macOS desktop control for DeepSeek Harness: agent operates non-browser apps (CapCut, Photoshop, WPS, native clients) like a human — 14 tools for mouse, keyboard, scrolling, app activation, windows and screenshots, plus a vision closed-loop (desktop_see for image understanding + desktop_locate for UI element coordinates) that reuses dsh existing vision credentials. GUI-session service starts on demand, no login autostart.
macOS 桌面控制插件：agent 像人一样操作非浏览器应用（剪映/PS/WPS/原生客户端）——14 个工具覆盖鼠标/键盘/滚动/应用/窗口/截图，并整合视觉闭环（desktop_see 识图 + desktop_locate UI 定位坐标，复用 dsh 既有视觉凭据）。服务 GUI 会话按需拉起，非登录自启。
How to install
dsh plugin add dsh-desktop-automation About
dsh-desktop-automation macOS 桌面自动化 dsh 插件：让 dsh 的 agent 能直接控制桌面——鼠标/键盘/滚动/应用/窗口/截图，并整合**视觉闭环**（截图 → 识图 → 定位 → 点击 → 验证）。 **主模型多模态/纯文本均可使用**：截图走系统 screencapture（屏幕录制已授权）；识图/定位复用 dsh 视觉凭据（OPENCODE_GO_API_KEY），与 dsh-autovision 共用同一套凭据，无需单独配 key。 它解决什么问题（主要功能） 浏览器自动化（playwright 等）只能操作网页；**非浏览器的桌面软件**——剪辑工具、设计软件、办公套件、系统设置、原生 App——一直够不着。这个插件把「agent 操作 macOS 桌面」补上：agent 像人一样看屏幕、移鼠标、敲键盘。 **核心场景**： **操作非浏览器应用**：剪映/PS/Axure/WPS/企业内部原生客户端——「点这里、填这个、导出那个」直接吩咐 **自动化办公**：批量重命名、表单填写、重复性 GUI 操作、跨应用搬运数据 **GUI 测试/验收**：对桌面软件跑「截图→操作→再截图验证」的闭环，替代人工点检 **远程指挥**：人在别处，让 dsh 在 Mac 上替你完成桌面操作 **视觉定位点击**：不依赖 accessibility …
Recommendation signals
Meta
- License
- MIT
- Language
- JavaScript
- GitHub stars
- 0
- mo. downloads
- 523
- Last push
- 2026-08-20
- Created
- 2026-08-19
Links
Basic safety check
- Findings
- None
- Sources
- curated:awesome-dsh-plugin.com, curated:awesome-dsh-plugin/awesome-dsh-plugin
- Topics
- desktop-automation, dsh-plugin, macos
Related plugins
dsh-bridge
wenbin-wb/dsh-bridge
Remote and mobile access for DeepSeek Harness: provides LAN QR code connection, Cloudflare/custom tunnels, WeChat, QQ, Feishu, Telegram bot integration, and security authentication.
dsh-ios
ZSeven-W/dsh-ios
A live iOS Simulator or USB-connected iPhone inside the conversation: 22 agent tools for booting, building, driving the UI by accessibility identity or OCR text, list-row actions and SwiftUI preview hot reload, plus a streaming sidebar panel you can tap and drag on.
dsh-tether
zexadev/dsh-tether
Use the dsh web UI on your dev machine from an Android or iOS phone, connected peer-to-peer across networks via iroh; no server to set up, with a relay fallback that only carries ciphertext.
dsh-web
zhu1090093659/dsh-web-ui/tree/main/packages/dsh-remote-web-ui
Remote control of a dsh web workspace from phone or PC: QR-code pairing through a token-gated channel, SSE real-time sync, and separate mobile and full desktop GUI modes.