Multilingual video dubbing—a technology review and current challenges

Frontiers in Signal Processing

Signal Processing

Peter Corcoran¹  Dan Bigioi² 

[1] null;[e-mail];

关键词: talking head generation;    dubbing;    deep fakes;    deep learning;    artificial intelligence;    video synthesis;    audio video synchronisation;   

DOI  :  10.3389/frsip.2023.1230755

 received in 2023-05-29, accepted in 2023-09-11,  发布年份 2023

来源: Frontiers

【 摘 要 】

The proliferation of multi-lingual content on today’s streaming services has created a need for automated multi-lingual dubbing tools. In this article, current state-of-the-art approaches are discussed with reference to recent works in automatic dubbing and the closely related field of talking head generation. A taxonomy of papers within both fields is presented, and the main challenges of both speech-driven automatic dubbing, and talking head generation are discussed and outlined, together with proposals for future research to tackle these issues.

【 授权许可】

Unknown   
Copyright © 2023 Bigioi and Corcoran.