dsh-desktop-control

LIMITATIONS

Known limitations

- **`find` depends on OCR.** Measured: 2–4 character menu items like "Insert" or "Workspace" hit at score 1.00; "Slide Show" was misread as "幻灯片囗节" and only matched partially. A miss returns the closest lines so the model can reword. - **Background capture is blank for some apps.** Windows that are not in the foreground are grabbed with `PrintWindow`, which returns an empty bitmap for GPU-rendered apps such as PowerPoint; `find` then tells you to `activate` first. Foreground windows use real screen pixels. - **UIA does not expose Chromium/Electron/Qt painted content.** Measured here: the DSH client, Edge and Abaqus only yield the window shell, title-bar buttons and menu bar. - **A missing or minimised `window` raises an error** instead of silently falling back to the full screen (which would capture another window and click the wrong place). - `sequence` does not wait for animations; insert an explicit `wait` step. - Windows only.