Abstract

Sequential manipulation requires a robot to track what has already happened, even when the current scene no longer reveals it. Policies with explicit history representations make past interactions available as context for current decisions. We ask how action generation itself can form a persistent state for subsequent control. Building on action-side test-time training, RecastVLA maintains an adaptive policy state within a flow-matching vision-language-action policy. The state is represented by shared fast weights and remains fixed throughout action generation. Depth-specific interfaces read the same state, while features across depths and flow evaluations jointly define one update for the next policy call. Subsequent action losses train the initialization, interfaces, and update rule by differentiating through earlier state transitions. At deployment, updates use the policy's own action-generation features without expert action labels. Across LIBERO, RoboTwin, RoboDojo, and twelve real-robot tasks, RecastVLA improves mean success over a matched policy trained without test-time training, including 10.68 percentage points on RoboTwin Clean-to-Clean. In controlled RoboTwin comparisons, retaining state improves success, and the shared design exceeds independently trained layer-local TTT by 2.58 points.

Keywords

Subject

Publication details

Journal
Not available
Open access
Green open access

Cite this article

APA 7

Li, W., Yang, J., Chen, Y., Zhang, W., & Wu, Q. (2026). RecastVLA: From Past Interaction to Future Control with Adaptive Policy States. https://omanscience.com/en/articles/recastvla-from-past-interaction-to-future-control-with-adaptive-policy-states

MLA 9

Li, Wenbo, et al. "RecastVLA: From Past Interaction to Future Control with Adaptive Policy States." https://omanscience.com/en/articles/recastvla-from-past-interaction-to-future-control-with-adaptive-policy-states.

Chicago (author–date)

Li, Wenbo, Jun Yang, Yiteng Chen, Wei Zhang, and Qingyao Wu. 2026. "RecastVLA: From Past Interaction to Future Control with Adaptive Policy States." https://omanscience.com/en/articles/recastvla-from-past-interaction-to-future-control-with-adaptive-policy-states.

Harvard

Li, W., Yang, J., Chen, Y., Zhang, W. and Wu, Q. (2026) 'RecastVLA: From Past Interaction to Future Control with Adaptive Policy States', Available at: https://omanscience.com/en/articles/recastvla-from-past-interaction-to-future-control-with-adaptive-policy-states.

Vancouver

Li W, Yang J, Chen Y, Zhang W, Wu Q. RecastVLA: From Past Interaction to Future Control with Adaptive Policy States. https://omanscience.com/en/articles/recastvla-from-past-interaction-to-future-control-with-adaptive-policy-states

IEEE

W. Li, J. Yang, Y. Chen, W. Zhang, and Q. Wu, "RecastVLA: From Past Interaction to Future Control with Adaptive Policy States," https://omanscience.com/en/articles/recastvla-from-past-interaction-to-future-control-with-adaptive-policy-states.