Files
hermes-agent/tools/computer_use
2ndNatureAI aeac982223 fix(computer_use): route explicit screen capture to get_desktop_state
'Screenshot my screen' previously resolved the 'screen' sentinel to the OS
shell window (Progman/WorkerW) via list_windows — capturing the wallpaper +
icons layer, never the windows actually displayed. cua-driver's
get_desktop_state does a real composited full-screen grab; the
screen/fullscreen/all sentinels now route there directly, bypassing window
enumeration (which also keeps screenshots working when Windows UIA
enumeration hangs — trycua/cua#2110/#2113).

app='desktop' keeps the shell-window lane so desktop icons/taskbar stay
clickable.

Salvaged from PR #60081 by @2ndNatureAI (surgical reapply; original branch
predates the capture-routing refactor).
2026-08-25 02:31:34 -07:00
..