الملخص
Spatial reasoning is fundamental to general robot intelligence, as it enables robots to complete long-horizon tasks involving multi-object interaction. We introduce Simify, a training-free, test-time framework that performs explicit spatial reasoning via massively parallel physics simulation. From a single RGB-D image of a scene, Simify reconstructs simulation-ready assets leveraging 3D generative models and vision-language models. Then given a task specified by a reward function (e.g., build the tallest tower), Simify launches thousands of parallel rollouts in simulation and performs an evolutionary search to optimize object arrangements, typically converging within seconds. We conduct quantitative experiments on real-robot hardware to demonstrate the ability of our framework to execute complex object rearrangement tasks end-to-end with previously unseen objects. Results show that our framework outperforms prior work on foundation models for spatial reasoning by effectively exploiting large-scale parallel simulation during inference, and also highlight the importance of complete and accurate geometry for successful sim-to-real transfer.
الكلمات المفتاحية
الموضوع
بيانات النشر
- المجلة
- غير متاح
- وصول مفتوح
- وصول مفتوح أخضر
اقتبس هذه المقالة
APA 7
Kapelyukh, I., Hu, Y., Gong, R., May, B., Kusnur, T., Herlant, L., Schmeckpeper, K., Johns, E., & Zhang, X. (2026). Test-Time Spatial Reasoning for Robot Manipulation Using Generative Real-to-Sim. https://omanscience.com/ar/articles/test-time-spatial-reasoning-for-robot-manipulation-using-generative-real-to-sim
MLA 9
Kapelyukh, Ivan, et al. "Test-Time Spatial Reasoning for Robot Manipulation Using Generative Real-to-Sim." https://omanscience.com/ar/articles/test-time-spatial-reasoning-for-robot-manipulation-using-generative-real-to-sim.
شيكاغو (المؤلف–التاريخ)
Kapelyukh, Ivan, Yafei Hu, Ran Gong, Brandon May, Tushar Kusnur, Laura Herlant, Karl Schmeckpeper, Edward Johns, and Xiaohan Zhang. 2026. "Test-Time Spatial Reasoning for Robot Manipulation Using Generative Real-to-Sim." https://omanscience.com/ar/articles/test-time-spatial-reasoning-for-robot-manipulation-using-generative-real-to-sim.
هارفارد
Kapelyukh, I., Hu, Y., Gong, R., May, B., Kusnur, T., Herlant, L., Schmeckpeper, K., Johns, E. and Zhang, X. (2026) 'Test-Time Spatial Reasoning for Robot Manipulation Using Generative Real-to-Sim', Available at: https://omanscience.com/ar/articles/test-time-spatial-reasoning-for-robot-manipulation-using-generative-real-to-sim.
فانكوفر
Kapelyukh I, Hu Y, Gong R, May B, Kusnur T, Herlant L, et al. Test-Time Spatial Reasoning for Robot Manipulation Using Generative Real-to-Sim. https://omanscience.com/ar/articles/test-time-spatial-reasoning-for-robot-manipulation-using-generative-real-to-sim
IEEE
I. Kapelyukh, Y. Hu, R. Gong, B. May, T. Kusnur, L. Herlant, K. Schmeckpeper, E. Johns, and X. Zhang, "Test-Time Spatial Reasoning for Robot Manipulation Using Generative Real-to-Sim," https://omanscience.com/ar/articles/test-time-spatial-reasoning-for-robot-manipulation-using-generative-real-to-sim.