Abstract
Autonomous excavation requires a spatial representation that jointly captures terrain geometry and task-relevant semantics. Existing excavation mapping is largely elevation-centric, while generic semantic models remain unstable in unstructured outdoor scenes. We present ExcavaTwin, a pure-vision geometry-guided semantic elevation mapping framework without excavation-specific training. Given multi-view RGB images, the framework: 1) reconstructs scene geometry and semantic observations using frozen vision models; 2) derives terrain and non-terrain geometric support; 3) performs geometry-constrained multi-view semantic fusion to suppress implausible predictions and recover incomplete observations; and 4) projects the fused state into a task-oriented semantic elevation map. Experiments on public datasets and real excavation scenes demonstrate reliable geometric and semantic perception. In real excavation, the system achieved an average update interval of approximately 1.4 s and a mean elevation error of 12.74cm in dynamically modified regions. Larger errors mainly occur during rapid terrain changes and transient visual disturbances caused by machine motion.
Keywords
Subject
Publication details
- Journal
- Not available
- Open access
- Green open access
Cite this article
APA 7
Deng, Y., Zeng, L., Hu, T., & Dai, R. (2026). ExcavaTwin: Training-Free Geometry-Guided Semantic Elevation Mapping for Autonomous Excavation. https://omanscience.com/en/articles/excavatwin-training-free-geometry-guided-semantic-elevation-mapping-for-autonomous-excavation
MLA 9
Deng, Yu, et al. "ExcavaTwin: Training-Free Geometry-Guided Semantic Elevation Mapping for Autonomous Excavation." https://omanscience.com/en/articles/excavatwin-training-free-geometry-guided-semantic-elevation-mapping-for-autonomous-excavation.
Chicago (author–date)
Deng, Yu, Lingshan Zeng, Tong Hu, and Rushi Dai. 2026. "ExcavaTwin: Training-Free Geometry-Guided Semantic Elevation Mapping for Autonomous Excavation." https://omanscience.com/en/articles/excavatwin-training-free-geometry-guided-semantic-elevation-mapping-for-autonomous-excavation.
Harvard
Deng, Y., Zeng, L., Hu, T. and Dai, R. (2026) 'ExcavaTwin: Training-Free Geometry-Guided Semantic Elevation Mapping for Autonomous Excavation', Available at: https://omanscience.com/en/articles/excavatwin-training-free-geometry-guided-semantic-elevation-mapping-for-autonomous-excavation.
Vancouver
Deng Y, Zeng L, Hu T, Dai R. ExcavaTwin: Training-Free Geometry-Guided Semantic Elevation Mapping for Autonomous Excavation. https://omanscience.com/en/articles/excavatwin-training-free-geometry-guided-semantic-elevation-mapping-for-autonomous-excavation
IEEE
Y. Deng, L. Zeng, T. Hu, and R. Dai, "ExcavaTwin: Training-Free Geometry-Guided Semantic Elevation Mapping for Autonomous Excavation," https://omanscience.com/en/articles/excavatwin-training-free-geometry-guided-semantic-elevation-mapping-for-autonomous-excavation.