Abstract
Full-duplex speech models can listen and speak simultaneously, enabling natural interaction, but become increasingly difficult to control as the conversation history grows. When used as user simulators, this lack of control can cause them to deviate from prescribed scenarios and produce unreliable evaluation outcomes. We introduce SimIF-Bench (Simulator Instruction-Following Benchmark), which evaluates whether a conversational model stays within a prescribed scenario and completes multiple goals in the required order. The benchmark reveals that current open-source full-duplex models struggle to follow such constraints. We then introduce a Group Reward-Decoupled Normalization Policy Optimization (GDPO)-based training recipe that enables a full-duplex model to follow textual instructions during an ongoing conversation while maintaining its turn-taking ability. By connecting the resulting SteerablePlex to an asynchronous backend language model that monitors the conversation and provides instructions when needed, we build a more controllable full-duplex user simulator that follows multi-stage constraints more reliably than existing open-source models and GPT-Realtime.
Keywords
Subject
Publication details
- Journal
- Not available
- Open access
- Green open access
Cite this article
APA 7
Zheng, H., Züfle, M., Macháček, D., Polák, P., Fan, X., Sumba, X., Wang, S., Klejch, O., & Hasegawa-Johnson, M. (2026). SteerablePlex: Can We Steer Full-Duplex Models? https://omanscience.com/en/articles/steerableplex-can-we-steer-full-duplex-models
MLA 9
Zheng, Haolong, et al. "SteerablePlex: Can We Steer Full-Duplex Models?" https://omanscience.com/en/articles/steerableplex-can-we-steer-full-duplex-models.
Chicago (author–date)
Zheng, Haolong, Maike Züfle, Dominik Macháček, Peter Polák, Xulin Fan, Xavier Sumba, Siyin Wang, Ondřej Klejch, and Mark Hasegawa-Johnson. 2026. "SteerablePlex: Can We Steer Full-Duplex Models?" https://omanscience.com/en/articles/steerableplex-can-we-steer-full-duplex-models.
Harvard
Zheng, H., Züfle, M., Macháček, D., Polák, P., Fan, X., Sumba, X., Wang, S., Klejch, O. and Hasegawa-Johnson, M. (2026) 'SteerablePlex: Can We Steer Full-Duplex Models?', Available at: https://omanscience.com/en/articles/steerableplex-can-we-steer-full-duplex-models.
Vancouver
Zheng H, Züfle M, Macháček D, Polák P, Fan X, Sumba X, et al. SteerablePlex: Can We Steer Full-Duplex Models? https://omanscience.com/en/articles/steerableplex-can-we-steer-full-duplex-models
IEEE
H. Zheng, M. Züfle, D. Macháček, P. Polák, X. Fan, X. Sumba, S. Wang, O. Klejch, and M. Hasegawa-Johnson, "SteerablePlex: Can We Steer Full-Duplex Models?," https://omanscience.com/en/articles/steerableplex-can-we-steer-full-duplex-models.