Preprint Open access
Watch Your Speech: Text-aware Video-to-Speech Synthesis with Textual Conditioning
Video-to-speech synthesis aims to generate natural-sounding speech from silent talking-face videos while ensuring phonetic accuracy. A fundamental challenge in this task is the inherent one-to-many mapping problem, where visual dynamics often lack sufficient information to uniquely determine the corresponding utterance …