Preprint Open access
DeskForge: Dense Supervision from Desktop Environments for Computer-Use Agents
Computer-use agents need to reliably ground action targets in complex desktop scenes, where multiple applications, overlapping windows, and visually similar controls compete for attention. Existing training data rarely pair such scenes with dense annotations or vary them in a controlled way. We introduce DeskForge, a c …