Abstract
Language-guided panoramic video generation benefits various downstream applications, such as interactive 3D scene exploration, virtual reality experiences, and embodied agent training. Existing panoramic generators follow predefined trajectories, and interactive world models act through low-level actions in perspective views. We propose SPW-Nav, a streaming panoramic world model that understands movement instructions and streams one minute of 2K 360-degree video in real time from a single panorama. SPW-Nav interprets each instruction in the previously generated panorama as camera motion. Spherical rotation decoupling applies rotation exactly on the sphere, pose-aligned conditioning keeps translation inputs bounded over long streams, and a multi-term memory with a few-step generator continues the scene as instructions change. We also build SPW-NavSet, panoramic videos with camera trajectories and verified instructions. Driven by language, SPW-Nav outperforms prior panoramic generators in camera-following accuracy and video quality, and supports on-the-fly instruction switching.
Keywords
Subject
Publication details
- Journal
- Not available
- Open access
- Green open access
Cite this article
APA 7
Liu, Y., Cai, Z., Yang, S., Wang, Y., Teng, M., Tan, J., Weng, S., Wu, E., Zhang, K., & Shi, B. (2026). SPW-Nav: A Streaming Panoramic World Model for Language-Guided Navigation. https://omanscience.com/en/articles/spw-nav-a-streaming-panoramic-world-model-for-language-guided-navigation
MLA 9
Liu, Yunheng, et al. "SPW-Nav: A Streaming Panoramic World Model for Language-Guided Navigation." https://omanscience.com/en/articles/spw-nav-a-streaming-panoramic-world-model-for-language-guided-navigation.
Chicago (author–date)
Liu, Yunheng, Ziqi Cai, Siqi Yang, Yimu Wang, Minggui Teng, Jiaming Tan, Shuchen Weng, Erwin Wu, Kaipeng Zhang, and Boxin Shi. 2026. "SPW-Nav: A Streaming Panoramic World Model for Language-Guided Navigation." https://omanscience.com/en/articles/spw-nav-a-streaming-panoramic-world-model-for-language-guided-navigation.
Harvard
Liu, Y., Cai, Z., Yang, S., Wang, Y., Teng, M., Tan, J., Weng, S., Wu, E., Zhang, K. and Shi, B. (2026) 'SPW-Nav: A Streaming Panoramic World Model for Language-Guided Navigation', Available at: https://omanscience.com/en/articles/spw-nav-a-streaming-panoramic-world-model-for-language-guided-navigation.
Vancouver
Liu Y, Cai Z, Yang S, Wang Y, Teng M, Tan J, et al. SPW-Nav: A Streaming Panoramic World Model for Language-Guided Navigation. https://omanscience.com/en/articles/spw-nav-a-streaming-panoramic-world-model-for-language-guided-navigation
IEEE
Y. Liu, Z. Cai, S. Yang, Y. Wang, M. Teng, J. Tan, S. Weng, E. Wu, K. Zhang, and B. Shi, "SPW-Nav: A Streaming Panoramic World Model for Language-Guided Navigation," https://omanscience.com/en/articles/spw-nav-a-streaming-panoramic-world-model-for-language-guided-navigation.