AuEmoChat: Authentic Emotion Understanding and Rendering for Conversational Speech Synthesis
Ranking
Overall
64
Content
75
Popularity
40
Observed public metrics from 1 member.
Merged summary
TL;DR - AuEmoChat is a conversational speech synthesis framework that learns discrete emotion tokens from real emotional speech rather than relying on a few predefined labels. It aims to generate more contextually consistent and authentic emotional speech.
- AuEmoCodec learns a discrete emotion space using finite scalar quantization.
- AuEmoToMe merges redundant multimodal dialogue-history tokens while preserving emotion-relevant context.
- An autoregressive text-speech model predicts both target emotion and speech tokens.
- Experiments on NCSSD-EmCap show improvements over state-of-the-art CSS baselines in expressiveness and emotional authenticity.
Sources (1)
AuEmoChat: Authentic Emotion Understanding and Rendering for Conversational Speech Synthesis
Public signals
Semantic Scholar citations 0 · Semantic Scholar influential citations 0
TL;DR - AuEmoChat is a conversational speech synthesis framework that learns discrete emotion tokens from real emotional speech rather than relying on a few predefined labels. It aims to generate more contextually consistent and authentic emotional speech.
- AuEmoCodec learns a discrete emotion space using finite scalar quantization.
- AuEmoToMe merges redundant multimodal dialogue-history tokens while preserving emotion-relevant context.
- An autoregressive text-speech model predicts both target emotion and speech tokens.
- Experiments on NCSSD-EmCap show improvements over state-of-the-art CSS baselines in expressiveness and emotional authenticity.