Preprint Open access
LoLBench: Evaluating Coding Agents with Long-Horizon Proposals on Large Software Systems
Modern coding agents can deliver increasingly large repository-level changes, and recent benchmarks reflect this by emphasizing long-horizon tasks with large reference implementations. Many benchmarks evaluate coding agents' implementation capability to produce correct code edits from detailed specifications. However, …