Abstract
We introduce \textbf{CoDeR}, a new paradigm for world modeling. Unlike existing video world models that implicitly represent world dynamics through visual observations, our system explicitly constructs an executable world with code and employs video generation models for visual realization. Specifically, we coordinate five complementary roles to translate high-level concepts into structured world rules, executable dynamics, and perceptual observations. This design enables \textit{long-term memory}, \textit{open-ended interactions}, \textit{autonomous world evolution}, and \textit{multi-agent scenarios}, where multiple entities can act, interact, and evolve persistently beyond the current observation. Extensive experiments demonstrate that our framework substantially extends the capabilities of existing world models, enabling long-term memory, open-ended interactions, autonomous evolution, and persistent multi-agent dynamics, while achieving state-of-the-art performance across multiple evaluation settings. Code and model weights will be made publicly available. Project Page: \href{https://becauseimbatman0.github.io/CoDeR}{CoDeR}.
Keywords
Publication details
- Journal
- Not available
- Open access
- Green open access
Cite this article
APA 7
Fang, Z., Shao, Y., Zhu, K., Xiao, J., Chen, S., Liu, Y., Fu, X., Cao, Y., Zhai, W., & Zha, Z. J. (2026). Code Plans, Diffusion Renders: Open-Ended Generative World Modeling. https://omanscience.com/en/articles/code-plans-diffusion-renders-open-ended-generative-world-modeling
MLA 9
Fang, Zixun, et al. "Code Plans, Diffusion Renders: Open-Ended Generative World Modeling." https://omanscience.com/en/articles/code-plans-diffusion-renders-open-ended-generative-world-modeling.
Chicago (author–date)
Fang, Zixun, Yawen Shao, Kai Zhu, Jie Xiao, Shihan Chen, Yu Liu, Xueyang Fu, Yang Cao, Wei Zhai, and Zheng-Jun Zha. 2026. "Code Plans, Diffusion Renders: Open-Ended Generative World Modeling." https://omanscience.com/en/articles/code-plans-diffusion-renders-open-ended-generative-world-modeling.
Harvard
Fang, Z., Shao, Y., Zhu, K., Xiao, J., Chen, S., Liu, Y., Fu, X., Cao, Y., Zhai, W. and Zha, Z. J. (2026) 'Code Plans, Diffusion Renders: Open-Ended Generative World Modeling', Available at: https://omanscience.com/en/articles/code-plans-diffusion-renders-open-ended-generative-world-modeling.
Vancouver
Fang Z, Shao Y, Zhu K, Xiao J, Chen S, Liu Y, et al. Code Plans, Diffusion Renders: Open-Ended Generative World Modeling. https://omanscience.com/en/articles/code-plans-diffusion-renders-open-ended-generative-world-modeling
IEEE
Z. Fang, Y. Shao, K. Zhu, J. Xiao, S. Chen, Y. Liu, X. Fu, Y. Cao, W. Zhai, and Z. J. Zha, "Code Plans, Diffusion Renders: Open-Ended Generative World Modeling," https://omanscience.com/en/articles/code-plans-diffusion-renders-open-ended-generative-world-modeling.