Abstract
Current methods for egocentric view action recognition often face challenges in perceiving dynamic hand movements relying solely on geometrical or physical information. In this work, we effectively address this problem by gaining insights into the correlation between functional hand configurations and objects, which improves the detailed interpretation of real-world scenarios. To this end, we introduce a practical taxonomy of hand types based on the functioning perspective and utilize it for per-frame hand type labeling on existing datasets. We also propose a novel hand action recognition framework considering semantic details of the hand type as prior. This approach boosts the network's understanding of the continuous hand interaction throughout the action sequence. Our whole pipeline consists of three main modules: (1) Feature Extraction, (2) Egocentric Knowledge Module, which estimates 3D hand pose, object category, and hand type leveraging short-term cues, and (2) Egocentric Action Module, which aggregates per-frame knowledge, including text embeddings of hand type, over a longer time. In our extensive experiments with large-scale benchmarks, FPHA and H2O, our model outperforms current state-of-the-art methods, demonstrating its superior performance.
Keywords
Subject
Publication details
- Journal
- Not available
- Open access
- Green open access
Cite this article
APA 7
Roh, W., Lee, S., Ryoo, W. J., Lee, J., Oh, G., Hwang, S., Chi, H. G., & Kim, S. (2026). Functional Hand Type Prior for 3D Hand Pose Estimation and Action Recognition from Egocentric View Monocular Videos. https://omanscience.com/en/articles/functional-hand-type-prior-for-3d-hand-pose-estimation-and-action-recognition-from-egocentric-view-monocular-videos
MLA 9
Roh, Wonseok, et al. "Functional Hand Type Prior for 3D Hand Pose Estimation and Action Recognition from Egocentric View Monocular Videos." https://omanscience.com/en/articles/functional-hand-type-prior-for-3d-hand-pose-estimation-and-action-recognition-from-egocentric-view-monocular-videos.
Chicago (author–date)
Roh, Wonseok, Seunghyun Lee, Won Jeong Ryoo, Jakyung Lee, Gyeongrok Oh, Sooyeon Hwang, Hyung-gun Chi, and Sangpil Kim. 2026. "Functional Hand Type Prior for 3D Hand Pose Estimation and Action Recognition from Egocentric View Monocular Videos." https://omanscience.com/en/articles/functional-hand-type-prior-for-3d-hand-pose-estimation-and-action-recognition-from-egocentric-view-monocular-videos.
Harvard
Roh, W., Lee, S., Ryoo, W. J., Lee, J., Oh, G., Hwang, S., Chi, H. G. and Kim, S. (2026) 'Functional Hand Type Prior for 3D Hand Pose Estimation and Action Recognition from Egocentric View Monocular Videos', Available at: https://omanscience.com/en/articles/functional-hand-type-prior-for-3d-hand-pose-estimation-and-action-recognition-from-egocentric-view-monocular-videos.
Vancouver
Roh W, Lee S, Ryoo WJ, Lee J, Oh G, Hwang S, et al. Functional Hand Type Prior for 3D Hand Pose Estimation and Action Recognition from Egocentric View Monocular Videos. https://omanscience.com/en/articles/functional-hand-type-prior-for-3d-hand-pose-estimation-and-action-recognition-from-egocentric-view-monocular-videos
IEEE
W. Roh, S. Lee, W. J. Ryoo, J. Lee, G. Oh, S. Hwang, H. G. Chi, and S. Kim, "Functional Hand Type Prior for 3D Hand Pose Estimation and Action Recognition from Egocentric View Monocular Videos," https://omanscience.com/en/articles/functional-hand-type-prior-for-3d-hand-pose-estimation-and-action-recognition-from-egocentric-view-monocular-videos.