Abstract
Expressive speech synthesis has advanced through prosody modeling, yet generating structured poetic speech, such as haiku, remains challenging. Prior work on prosody transfer improves expressiveness, and fine-tuned poetry TTS (text-to-speech) systems capture verse intonation. However, these models do not model haiku's 5-7-5 syllable structure or line-ending pauses. We present a cascaded system, HaikuS2S, combining ASR (automatic speech recognition), LLM (large language model)-generated haiku, and TTS fine-tuning on both prose and custom haiku datasets. Our evaluation focuses on emotion similarity, speech quality, and prosody alignment. In our experiments, we see that our prosody and tonal alignment improve significantly with our fine-tuned systems, particularly the one trained on both general poetry and haiku. We also see that we maintain similar emotion similarity scores across all systems.
Keywords
Publication details
- Journal
- Not available
- Open access
- Green open access
Cite this article
APA 7
Sharma, D., Judicke, S., Tan, G., Schaumburg, C., & Watanabe, S. (2026). HaikuS2S: A Cascaded System For Responding In Verse. https://omanscience.com/en/articles/haikus2s-a-cascaded-system-for-responding-in-verse
MLA 9
Sharma, Devangi, et al. "HaikuS2S: A Cascaded System For Responding In Verse." https://omanscience.com/en/articles/haikus2s-a-cascaded-system-for-responding-in-verse.
Chicago (author–date)
Sharma, Devangi, Sophia Judicke, Glenda Tan, Conrad Schaumburg, and Shinji Watanabe. 2026. "HaikuS2S: A Cascaded System For Responding In Verse." https://omanscience.com/en/articles/haikus2s-a-cascaded-system-for-responding-in-verse.
Harvard
Sharma, D., Judicke, S., Tan, G., Schaumburg, C. and Watanabe, S. (2026) 'HaikuS2S: A Cascaded System For Responding In Verse', Available at: https://omanscience.com/en/articles/haikus2s-a-cascaded-system-for-responding-in-verse.
Vancouver
Sharma D, Judicke S, Tan G, Schaumburg C, Watanabe S. HaikuS2S: A Cascaded System For Responding In Verse. https://omanscience.com/en/articles/haikus2s-a-cascaded-system-for-responding-in-verse
IEEE
D. Sharma, S. Judicke, G. Tan, C. Schaumburg, and S. Watanabe, "HaikuS2S: A Cascaded System For Responding In Verse," https://omanscience.com/en/articles/haikus2s-a-cascaded-system-for-responding-in-verse.