الملخص
Earth observation (EO) data provide rich temporal supervision, yet existing remote sensing foundation models mainly exploit sequential observations through imposing predefined pairwise relations or aggregating holistic reconstruction context. We seek to further exploit the sparse and nonuniform temporal sampling inherent in EO sequences as supervisory signals. To this end, we propose T-JEPA, a temporal joint-embedding predictive architecture that learns time-gap-conditioned latent transitions. A shared single-frame encoder processes each observation, while a temporal predictor estimates the complete target latent field from a masked source latent representation and the actual elapsed time. Across multiple temporal intervals, these predictive constraints organize observed states into structured latent trajectories. Asymmetric metadata injection mitigates shortcut learning, and direct supervision across multiple temporal scales proves more effective than recursively rolling out intermediate states. In parallel, masked pixel reconstruction provides complementary supervision for preserving spatial details. Under matched pre-training data and throughput, T-JEPA achieves leading transfer performance on both static and temporal tasks. Analyses further reveal that T-JEPA learns representations with time-gap-dependent transition predictability and coherent latent dynamics, while maintaining strong cross-period consistency, representation diversity, and semantic discriminability.
الكلمات المفتاحية
الموضوع
بيانات النشر
- المجلة
- غير متاح
- وصول مفتوح
- وصول مفتوح أخضر
اقتبس هذه المقالة
APA 7
Peng, B., Liu, L., Liu, Y., Li, W., Zhou, J., & Liu, Z. (2026). T-JEPA: A Temporal Joint-Embedding Predictive Architecture for Learning Better Remote Sensing Representations. https://omanscience.com/ar/articles/t-jepa-a-temporal-joint-embedding-predictive-architecture-for-learning-better-remote-sensing-representations
MLA 9
Peng, Bowen, et al. "T-JEPA: A Temporal Joint-Embedding Predictive Architecture for Learning Better Remote Sensing Representations." https://omanscience.com/ar/articles/t-jepa-a-temporal-joint-embedding-predictive-architecture-for-learning-better-remote-sensing-representations.
شيكاغو (المؤلف–التاريخ)
Peng, Bowen, Li Liu, Yongxiang Liu, Weijie Li, Jie Zhou, and Zhen Liu. 2026. "T-JEPA: A Temporal Joint-Embedding Predictive Architecture for Learning Better Remote Sensing Representations." https://omanscience.com/ar/articles/t-jepa-a-temporal-joint-embedding-predictive-architecture-for-learning-better-remote-sensing-representations.
هارفارد
Peng, B., Liu, L., Liu, Y., Li, W., Zhou, J. and Liu, Z. (2026) 'T-JEPA: A Temporal Joint-Embedding Predictive Architecture for Learning Better Remote Sensing Representations', Available at: https://omanscience.com/ar/articles/t-jepa-a-temporal-joint-embedding-predictive-architecture-for-learning-better-remote-sensing-representations.
فانكوفر
Peng B, Liu L, Liu Y, Li W, Zhou J, Liu Z. T-JEPA: A Temporal Joint-Embedding Predictive Architecture for Learning Better Remote Sensing Representations. https://omanscience.com/ar/articles/t-jepa-a-temporal-joint-embedding-predictive-architecture-for-learning-better-remote-sensing-representations
IEEE
B. Peng, L. Liu, Y. Liu, W. Li, J. Zhou, and Z. Liu, "T-JEPA: A Temporal Joint-Embedding Predictive Architecture for Learning Better Remote Sensing Representations," https://omanscience.com/ar/articles/t-jepa-a-temporal-joint-embedding-predictive-architecture-for-learning-better-remote-sensing-representations.