Preprint Open access
SecProbe: Adaptive Evaluation of Coding Agents on Cybersecurity Vulnerabilities
Assessing cybersecurity vulnerability awareness in coding agents requires evaluations that reveal capability gaps and remain informative as models evolve. Static benchmarks offer fixed coverage and difficulty, while scarce vulnerable repositories and costly expert authoring limit their renewal at scale. We introduce Se …