Preprint Open access
MobileCybench: Evaluating Agent Vulnerability Discovery via Executable Probes
AI agents now report vulnerabilities faster than maintainers can review them. Reports often depend on security properties specific to the application, and require considerable human labor to process. To mitigate this, we introduce a framework for evaluating vulnerability reports via probes, executable checks of securit …