Abstract
Generating realistic 3D dance from music is a challenging task that requires accurate synchronization with musical rhythms while capturing the spatial complexity of human motion. Although existing methods can generate physically plausible dance motions, they often struggle to achieve precise alignment with music, such as the beat. To address this limitation, we propose a novel diffusion-based framework, BeatDance, with two components: 1) We present a Hierarchical Decoupled Attention (HDA) module, which first disentangles the learning of human pose and temporal dynamics. A hierarchical structure is then employed to capture both short-term and long-term dependencies, thereby enhancing spatial-temporal modeling. 2) We adopt cycle-consistent learning by introducing an auxiliary dance-to-music module. During training, discrepancies between the reconstructed and original music induce a stronger loss signal, effectively encouraging the consistency property between the music and dance motion. Extensive experimental results demonstrate that our proposed approach outperforms recent competitive methods on two benchmark datasets.
Keywords
Subject
Publication details
- DOI
- 10.1016/j.patcog.2026.114344
- Journal
- Not available
- Open access
- Green open access
Cite this article
APA 7
Shen, X., Shi, D., Zhang, J., Li, H., Zhao, H., Zhang, D., Zhuge, Y., Wu, Z., Yue, G., & Zhou, W. (2026). BeatDance: Generating Beat-Consistent 3D Dance with Hierarchical Spatial-Temporal Modeling. https://doi.org/10.1016/j.patcog.2026.114344
MLA 9
Shen, Xiaojian, et al. "BeatDance: Generating Beat-Consistent 3D Dance with Hierarchical Spatial-Temporal Modeling." https://doi.org/10.1016/j.patcog.2026.114344.
Chicago (author–date)
Shen, Xiaojian, Dahu Shi, Jianrong Zhang, Hai Li, Hongwei Zhao, Dawei Zhang, Yunzhi Zhuge, Zhiliang Wu, Guanghui Yue, and Wei Zhou. 2026. "BeatDance: Generating Beat-Consistent 3D Dance with Hierarchical Spatial-Temporal Modeling." https://doi.org/10.1016/j.patcog.2026.114344.
Harvard
Shen, X., Shi, D., Zhang, J., Li, H., Zhao, H., Zhang, D., Zhuge, Y., Wu, Z., Yue, G. and Zhou, W. (2026) 'BeatDance: Generating Beat-Consistent 3D Dance with Hierarchical Spatial-Temporal Modeling', doi:10.1016/j.patcog.2026.114344.
Vancouver
Shen X, Shi D, Zhang J, Li H, Zhao H, Zhang D, et al. BeatDance: Generating Beat-Consistent 3D Dance with Hierarchical Spatial-Temporal Modeling. doi:10.1016/j.patcog.2026.114344
IEEE
X. Shen, D. Shi, J. Zhang, H. Li, H. Zhao, D. Zhang, Y. Zhuge, Z. Wu, G. Yue, and W. Zhou, "BeatDance: Generating Beat-Consistent 3D Dance with Hierarchical Spatial-Temporal Modeling," doi: 10.1016/j.patcog.2026.114344.