الباحثون

ساكسون روانغتانوساك

المنشورات 2

نسخة أولية وصول مفتوح

When a Kindergartener Solves Calculus: Measuring Capability Leakage in Role-Prompted Reasoning Models

We investigate the problem of role-capability leakage (RCL), in which a role-prompted reasoning model generates convincing in-role text while continuing to exhibit capabilities on benchmarks that exceed those implied by the assigned role. For example, when a model is prompted to assume the role of a kindergarten studen …

نسخة أولية وصول مفتوح

SCB: SpeechConversationBench for Evaluating Multi-Turn Reasoning in Speech-to-Speech Models

Speech-to-speech systems must solve tasks whose requirements emerge across conversational turns. We introduce SpeechConversationBench (SCB), a focused evaluation of spoken mathematical reasoning using 103 sharded GSM8K problems. The framework compares the original problem delivered in one turn (full), its concatenated …

المؤلفون المشاركون