2510.09245

Total: 1

#1 SynthVC: Leveraging Synthetic Data for End-to-End Low Latency Streaming Voice Conversion [PDF2] [Copy] [Kimi4] [REL]

Authors: Zhao Guo, Ziqian Ning, Guobin Ma, Lei Xie

Voice Conversion (VC) aims to modify a speaker's timbre while preserving linguistic content. While recent VC models achieve strong performance, most struggle in real-time streaming scenarios due to high latency, dependence on ASR modules, or complex speaker disentanglement, which often results in timbre leakage or degraded naturalness. We present SynthVC, a streaming end-to-end VC framework that directly learns speaker timbre transformation from synthetic parallel data generated by a pre-trained zero-shot VC model. This design eliminates the need for explicit content-speaker separation or recognition modules. Built upon a neural audio codec architecture, SynthVC supports low-latency streaming inference with high output fidelity. Experimental results show that SynthVC outperforms baseline streaming VC systems in both naturalness and speaker similarity, achieving an end-to-end latency of just 77.1 ms.

Subjects: Sound , Audio and Speech Processing

Publish: 2025-10-10 10:33:20 UTC