نسخة أولية وصول مفتوح
Backward-State Policy Is Part of the Learning Algorithm
Low-precision training rounds tensors that the backward pass reads again, often for several gradients; each use can read the forward's rounded value, the original, or a new random rounding. This backward-state policy looks like a memory and precision detail, settled by copy accuracy and final loss. We argue that it is …