Community · E2 · artifact verified
Drive macOS from structured screen state
A computer-use loop combines OCR and accessibility data, then asks Jev which bounded action should move the Mac toward a plain-English goal.
01 · Role in the system
What Jev does here
Jev classifies the next action and, when relevant, the visible or off-screen target from a numbered screen inventory. Capture, OCR, accessibility traversal, date arithmetic, action execution, and stop conditions remain deterministic. A writing model is isolated to free-text fields and proposed URLs, and password fields are refused.
02 · Control boundary
Where Jev sits
OCR and accessibility observations become parallel Choices; code owns permissions, safety stops, and input execution.
Code owns the loop, permissions, thresholds, validation, and side effects. Jev owns only the bounded judgments described above.
03 · Known limits
What this evidence does not prove
- It targets macOS and requires Screen Recording and Accessibility permissions.
- OCR and accessibility coverage miss canvas content, icon-only controls, and applications with weak accessibility trees.
04 · Attribution
Public sources
This is a Community record: the project was published by a third-party community author.
- awlevin ↗Community · github · public · checked 2026-09-18