الملخص
Efficient exploration often remains a central bottleneck in reinforcement learning with verifiable rewards (RLVR). Although temperature control and test-time scaling strategies can increase rollout diversity of large language models (LLMs), they either expand the sample budget at rollout time or leave the benefit of exploration unquantified. To this end, we propose Temperature-Grouped Reinforcement Learning (TGRL), which turns temperature-induced diversity into an explicit training signal. For each prompt, TGRL partitions its rollout group into low- and high-temperature subsets, estimates exploration gain through their reward contrast, and allocates this group-level signal as token-level credit using Jensen--Shannon (JS) divergence between the corresponding temperature-scaled next-token distributions induced by the same logits. Notably, TGRL reaches equivalent accuracy up to 36% faster than strong RLVR baselines without expanding the rollout budget. Across 11 benchmarks from diverse domains, TGRL broadly improves over strong RLVR baselines: it improves the six-benchmark math average by 1.6% at 32B, raises CodeForces rating by 196.7 points and LiveCodeBench Pass@16 by 4.4%, and improves ALFWorld/WebShop success rates by 6.3%/4.9%. Comprehensive ablations and wall-clock analysis confirm the efficacy of all proposed components. Code is available at https://github.com/1229095296/TGRL/tree/main.
الكلمات المفتاحية
الموضوع
بيانات النشر
- المجلة
- غير متاح
- وصول مفتوح
- وصول مفتوح أخضر
اقتبس هذه المقالة
APA 7
Lin, Z., Wang, X., Cao, J., Chai, J., Lin, W., Yin, G., & He, R. (2026). TGRL: Temperature-Grouped Reinforcement Learning for Efficient Exploration in LLMs. https://omanscience.com/ar/articles/tgrl-temperature-grouped-reinforcement-learning-for-efficient-exploration-in-llms
MLA 9
Lin, Zihan, et al. "TGRL: Temperature-Grouped Reinforcement Learning for Efficient Exploration in LLMs." https://omanscience.com/ar/articles/tgrl-temperature-grouped-reinforcement-learning-for-efficient-exploration-in-llms.
شيكاغو (المؤلف–التاريخ)
Lin, Zihan, Xiaohan Wang, Jie Cao, Jiajun Chai, Wei Lin, Guojun Yin, and Ran He. 2026. "TGRL: Temperature-Grouped Reinforcement Learning for Efficient Exploration in LLMs." https://omanscience.com/ar/articles/tgrl-temperature-grouped-reinforcement-learning-for-efficient-exploration-in-llms.
هارفارد
Lin, Z., Wang, X., Cao, J., Chai, J., Lin, W., Yin, G. and He, R. (2026) 'TGRL: Temperature-Grouped Reinforcement Learning for Efficient Exploration in LLMs', Available at: https://omanscience.com/ar/articles/tgrl-temperature-grouped-reinforcement-learning-for-efficient-exploration-in-llms.
فانكوفر
Lin Z, Wang X, Cao J, Chai J, Lin W, Yin G, et al. TGRL: Temperature-Grouped Reinforcement Learning for Efficient Exploration in LLMs. https://omanscience.com/ar/articles/tgrl-temperature-grouped-reinforcement-learning-for-efficient-exploration-in-llms
IEEE
Z. Lin, X. Wang, J. Cao, J. Chai, W. Lin, G. Yin, and R. He, "TGRL: Temperature-Grouped Reinforcement Learning for Efficient Exploration in LLMs," https://omanscience.com/ar/articles/tgrl-temperature-grouped-reinforcement-learning-for-efficient-exploration-in-llms.