Abstract
We present LiteReality-Agent, an agentic system for reconstructing real indoor environments as realistic, articulated, and simulation-ready 3D scenes from RGB-D scans. At its core, LiteReality-Agent formulates 3D reconstruction as a coding problem, in which a coding agent gathers evidence using specialised tools and iteratively edits a Python script, Room.py, which can be executed to produce a 3D digital twin of the room. With this formulation, we develop a robust observe-edit-verify harness that supports evidence gathering, measurement, verification, layout optimisation, simulation readiness, and quality control throughout the reconstruction process. LiteReality-Agent produces high-quality reconstructions suitable for simulation and downstream embodied AI tasks. Furthermore, as agent capabilities continue to improve rapidly, the system introduced by LiteReality-Agent remains a strong orchestration framework for future agents: it equips them with specialised tools, structured workflows, and robust verification mechanisms that substantially improve reconstruction quality and reliability. We demonstrate that LiteReality-Agent produces reconstructions that are more geometrically accurate, visually realistic, and simulation-compatible than those generated by recent frontier models, such as Astra and Fable. We therefore view LiteReality-Agent as a practical and important building block for robust real-to-sim systems. Both the source code and the data-capture application are publicly available. Code:https://github.com/LiteReality/LiteReality-Agent/
Keywords
Subject
Publication details
- Journal
- Not available
- Open access
- Green open access
Cite this article
APA 7
Huang, Z., Li, Y., Chiu, J., Lyu, X., Zhou, M., Yao, Y., Lasenby, J., & Wu, S. (2026). LiteReality-Agent: An Agentic System for Interactable 3D Indoor Scene Reconstruction. https://omanscience.com/en/articles/litereality-agent-an-agentic-system-for-interactable-3d-indoor-scene-reconstruction
MLA 9
Huang, Zhening, et al. "LiteReality-Agent: An Agentic System for Interactable 3D Indoor Scene Reconstruction." https://omanscience.com/en/articles/litereality-agent-an-agentic-system-for-interactable-3d-indoor-scene-reconstruction.
Chicago (author–date)
Huang, Zhening, Yueyan Li, Johnathan Chiu, Xiaoyang Lyu, Matt Zhou, Yuxin Yao, Joan Lasenby, and Shangzhe Wu. 2026. "LiteReality-Agent: An Agentic System for Interactable 3D Indoor Scene Reconstruction." https://omanscience.com/en/articles/litereality-agent-an-agentic-system-for-interactable-3d-indoor-scene-reconstruction.
Harvard
Huang, Z., Li, Y., Chiu, J., Lyu, X., Zhou, M., Yao, Y., Lasenby, J. and Wu, S. (2026) 'LiteReality-Agent: An Agentic System for Interactable 3D Indoor Scene Reconstruction', Available at: https://omanscience.com/en/articles/litereality-agent-an-agentic-system-for-interactable-3d-indoor-scene-reconstruction.
Vancouver
Huang Z, Li Y, Chiu J, Lyu X, Zhou M, Yao Y, et al. LiteReality-Agent: An Agentic System for Interactable 3D Indoor Scene Reconstruction. https://omanscience.com/en/articles/litereality-agent-an-agentic-system-for-interactable-3d-indoor-scene-reconstruction
IEEE
Z. Huang, Y. Li, J. Chiu, X. Lyu, M. Zhou, Y. Yao, J. Lasenby, and S. Wu, "LiteReality-Agent: An Agentic System for Interactable 3D Indoor Scene Reconstruction," https://omanscience.com/en/articles/litereality-agent-an-agentic-system-for-interactable-3d-indoor-scene-reconstruction.