Abstract
Humanoid avatars extend human physical presence beyond the body, enabling people to participate in social, service, and labor activities through remotely operated robots. This requires teleoperation systems capable of realizing diverse and dynamic whole-body behaviors while maintaining responsive human-robot synchronization. We present General Action Expert(GAE), a unified learning framework for general-purpose, low-latency humanoid whole-body teleoperation. To cover diverse human behaviors, GAE builds a large-scale human motion dataset from heterogeneous sources, including videos, animations, and motion capture, followed by standardization and augmentation. GAE then addresses the noise and embodiment mismatch in human motions with a two-stage training paradigm: a privileged generator policy first tracks human motion references in simulation and rolls out feasible humanoid trajectories; a deployable executor policy then learns to track these generated trajectories under curriculum domain randomization. For responsive human-robot synchronization, GAE introduces a latency-conditioned anticipation mechanism that adaptively compensates for end-to-end delay during real-time teleoperation. Simulation and real-world experiments on Unitree G1 and Westlake O1 robots demonstrate that GAE enables humanoids to smoothly mirror diverse, agile, and expressive human behaviors. Project website: https://wangyf0928.github.io/gae-wlrobotics/
Keywords
Subject
Publication details
- Journal
- Not available
- Open access
- Green open access
Cite this article
APA 7
Wang, Y., Zhou, H., He, X., He, Z., Yang, M., Zhang, H., Chai, L., Liu, J., & Wang, D. (2026). GAE: General Action Expert for Real-Time Humanoid Teleoperation. https://omanscience.com/en/articles/gae-general-action-expert-for-real-time-humanoid-teleoperation
MLA 9
Wang, Yuefan, et al. "GAE: General Action Expert for Real-Time Humanoid Teleoperation." https://omanscience.com/en/articles/gae-general-action-expert-for-real-time-humanoid-teleoperation.
Chicago (author–date)
Wang, Yuefan, Huaicheng Zhou, Xiao He, Zhijie He, Mingchuan Yang, Huayi Zhang, Li Chai, Jinxin Liu, and Donglin Wang. 2026. "GAE: General Action Expert for Real-Time Humanoid Teleoperation." https://omanscience.com/en/articles/gae-general-action-expert-for-real-time-humanoid-teleoperation.
Harvard
Wang, Y., Zhou, H., He, X., He, Z., Yang, M., Zhang, H., Chai, L., Liu, J. and Wang, D. (2026) 'GAE: General Action Expert for Real-Time Humanoid Teleoperation', Available at: https://omanscience.com/en/articles/gae-general-action-expert-for-real-time-humanoid-teleoperation.
Vancouver
Wang Y, Zhou H, He X, He Z, Yang M, Zhang H, et al. GAE: General Action Expert for Real-Time Humanoid Teleoperation. https://omanscience.com/en/articles/gae-general-action-expert-for-real-time-humanoid-teleoperation
IEEE
Y. Wang, H. Zhou, X. He, Z. He, M. Yang, H. Zhang, L. Chai, J. Liu, and D. Wang, "GAE: General Action Expert for Real-Time Humanoid Teleoperation," https://omanscience.com/en/articles/gae-general-action-expert-for-real-time-humanoid-teleoperation.