Based in Rotkreuz in the canton of Zug, the start-up vidby has launched a new voice cloning functionality for multi-language video dubbing. This is said to be helpful for anyone that wishes to translate and dub videos using their own voice.
In order to use this new functionality, users must submit a voice recording of at least five minutes in length to be saved on the vidby platform, further details of which can be found in a press release. A digital voice clone is generated within a matter of minutes, which afterwards can be used for the audio dubbing of videos.
Once the voice clone has been generated, it is stored in the user account and is only accessible to the respective user, the press release explains. The platform currently supports cloned dubs for 28 languages, including some of the most widely spoken languages on Earth such as English, German, Spanish, Mandarin and Hindi.
As far as interlingual cloning is concerned, it is not just about “mimicking the voice’s tone and sound, but also about mastering the language’s pronunciation without that distinct accent”, as Alexander Konovalov, CEO and co-founder of vidby, explains in the press release. In technological terms, this is “quite a challenge” and has only been mastered by a handful of companies. The price for digital voice creation is 10 US dollars, with voiceover services using cloned voices charged at 3 US dollars per minute.
Vidby offers software powered by AI for to rapidly and accurately translate and dub videos in 70 languages. Founded at the end of July 2023, the company enjoys the status of a Google technology partner and is a recommended vendor by YouTube.
