Preprint Open access
Critical-State RL: Diagnosing Trainable States for Multi-Turn Tool Use
Multi-turn tool-use failures can hinge on a single model call, yet reward variation alone does not reveal which call would benefit from training. When rewards depend on later interactions, their variation can reflect downstream randomness rather than differences between the current actions. We introduce Critical-State …