Preprint Open access
Trajectory-Retrieval Speculative Decoding: When Does a Model's Own History Help?
Long chain-of-thought reasoning increases sequential decoding cost while creating a growing history of potentially reusable continuations. We investigate when this history supplies useful drafts and complements an existing drafter. Controlled source comparisons reveal trajectory-specific reuse, motivating our method Tr …