Preprint Open access
OSWorld-Science: A Benchmark of Computer Use Agents for Learning and Using Scientific Software
Scientific software presents a demanding test for computer-using agents based on visual language models (VLMs): completing a research workflow requires interpreting specialized interfaces, manipulating scientific objects, and producing verifiable results. We thus introduce OSWorld-Science, a benchmark and evaluation en …