论文标题
端到端代码转换TTS中段落处理的文本增强
Text Enhancement for Paragraph Processing in End-to-End Code-switching TTS
论文作者
论文摘要
当前的端到端代码转换文本到语音（TTS）已经可以通过单个扬声器双语语料库在同一语音中生成高质量的两种语言。当双语语料库的发言者不同时，代码开关TT的自然性和一致性将很差。我们提出的跨语性嵌入层结构在不同语言中具有相似的音节，从而提高了产生的语音的自然性和一致性。在端到端的代码转换TT中，综合段落文本时存在韵律不稳定的问题。我们提出的文本增强方法使输入包含韵律信息和句子级上下文信息，从而改善了段落文本的韵律稳定性。实验结果证明了所提出的方法在自然性，一致性和韵律稳定性中的有效性。除了普通话和英语外，我们还将这些方法应用于上海和广东话语料库，证明我们建议的方法可以扩展到其他语言以构建端到端代码转换TTS系统。
Current end-to-end code-switching Text-to-Speech (TTS) can already generate high quality two languages speech in the same utterance with single speaker bilingual corpora. When the speakers of the bilingual corpora are different, the naturalness and consistency of the code-switching TTS will be poor. The cross-lingual embedding layers structure we proposed makes similar syllables in different languages relevant, thus improving the naturalness and consistency of generated speech. In the end-to-end code-switching TTS, there exists problem of prosody instability when synthesizing paragraph text. The text enhancement method we proposed makes the input contain prosodic information and sentence-level context information, thus improving the prosody stability of paragraph text. Experimental results demonstrate the effectiveness of the proposed methods in the naturalness, consistency, and prosody stability. In addition to Mandarin and English, we also apply these methods to Shanghaiese and Cantonese corpora, proving that the methods we proposed can be extended to other languages to build end-to-end code-switching TTS system.
