Overview
dsh-vision
DSH Computer Use (vision + desktop control, auto-detects Windows native or WSL): see the Windows screen through the agent vision channel, drive mouse/keyboard with a Codex-style blue overlay (Esc to abort), plus a composer status pill.
README / EN
Package documentation
Registry summary
DSH Computer Use (vision + desktop control, auto-detects Windows native or WSL): see the Windows screen through the agent vision channel, drive mouse/keyboard with a Codex-style blue overlay (Esc to abort), plus a composer status pill.
dsh.pub verifies the pinned bundle contract, runtime facts, and distribution semantics. The complete README remains in the source repository.
Read the full README on GitHubLIMITATIONS
Known limitations
- **Chromium 忽略 `KEYEVENTF_UNICODE` 注入**：往 Edge/Chrome/微信打字用 `typevk`（真实 VK 按键，跨应用通用） - **中文/非 ASCII 走输入法**：`computer_key` 依次发拼音字母（如 `n,i,h,a,o`）→ `computer_key` `space`（或数字键选候选）上屏；`computer_type` 的默认路径会**明确拒绝**非 ASCII 而不是偷偷回退剪贴板 - **剪贴板模式默认关闭**：仅在显式 `method: 'clipboard'` 时启用（注意：它会覆盖用户剪贴板内容） - **WinUI（记事本等）不认注入的 Ctrl 组合键**：`computer_key` 对这类应用可能无效 - **自绘 UI 的 UIA 坐标不可信**（Edge 标签栏、Win11 记事本标签页会返回 ∞ 或错位）：请先 `view_screen` 肉眼定位再点 - **带自绘光标的软件**（游戏、部分 Electron 应用）无法被系统级光标替换覆盖 - **Linux / macOS 宿主**：当前只支持 Windows 原生与 WSL + Windows；其他系统下 `view_image` 可用，桌面工具会明确报错 ---