Preprint Open access
TraceDance: An Automated System for Building Agent Behavior Benchmarks from Real-World Agent Deployment Traces
An agent can complete a task while exhibiting undesirable behavior during execution. Developers need tests for the specific behaviors encountered in deployment, beyond fixed benchmark suites. We present TraceDance, an agent system that constructs targeted benchmarks from deployment traces for user-specified undesirable …