Preprint Open access
CodeActionBench: Evaluating Agentic Code-as-Policy for Embodied Manipulation
How well can general-purpose multimodal models turn visual understanding and reasoning into embodied manipulation via executable code? We introduce CodeActionBench, a benchmark of 25 manipulation tasks that evaluates this capability through agentic Code-as-Policy. Without task-specific fine-tuning, demonstrations, exte …