create account

HeyGen AI-generated lip-sync translations are insane, could completely replace dubbing of movies eventually by vikisecrets

View this thread on: hive.blogpeakd.comecency.com
· @vikisecrets ·
$10.20
HeyGen AI-generated lip-sync translations are insane, could completely replace dubbing of movies eventually
HeyGen bietet AI-generierte, Lippen-synchrone Übersetzungen von Videos an, wobei sowohl die Stimme als auch die Emotionen und die Person selbst erhalten bleiben.

Habe mir ein paar Beispiel-Videos angesehen und die Qualität ist schon ziemlich beeindruckend und ein sinnvoller Einsatz und Weiterentwicklung der Deep-Fake-Technologie.

Die Frage ist natürlich, ob es für den professionellen Einsatz gut genug ist, aber kann mir schon vorstellen, dass man damit das ein oder andere Video in Zukunft extrem authentisch übersetzen kann und zwar zu extrem niedrigen Kosten. Enorme Produktivitätssteigerung.

Die Stimme klingt manchmal noch ein bisschen künstlich, roboterhaft (fällt aber nach einiger Zeit kaum auf) und bei der deutschen Übersetzung hackt es noch ein bisschen.

So wird das englische Idiom "There we go" im unteren Video wörtlich mit "da gehen wir" übersetzt, was natürlich Blödsinn ist.

Eine bessere Übersetzung wäre zum Beispiel "geht doch", "na bitte" oder "da haben wir's".

Ok, da haben wir's. Was sagt ihr zu lippen-synchronen Übersetzung mit der selben Stimme wie das Original mit HeyGen?

## HeyGen AI-generated speakers and lip-sync translation

![image.png](https://files.peakd.com/file/peakd-hive/vikisecrets/23zGyvTBELFZWSKimVNVPupkw7eoWt741axo5uVy8BuGezKqVWmwTNzSnvCbMis8Nd6V9.png)

https://www.heygen.com/

https://labs.heygen.com/video-translate

## Example

https://twitter.com/mrjonfinger/status/1701075571630047525

## English

HeyGen offers AI-generated, lip-sync translations of videos, preserving both the voice and the emotions and the person themselves.

Watched a few sample videos and the quality is quite impressive and a useful use and advancement of deep fake technology.

The question is, of course, whether it is good enough for professional use, but I can already imagine that many videos will be translated extremely authentically with it in the future and at extremely low cost. Enormous increase in productivity.

The voice sometimes still sounds a bit artificial, robotic (but hardly noticeable after a while) and there are still some issues with the German translation.

For example, the English idiom "There we go" is literally translated as "da gehen wir" in the video below, which is of course incorrect.

A better translation would be, for example, "geht doch", "na bitte" or "da hast wir's".

Okay, there we go. What do you say to lip-sync translation with the same voice as the original person with HeyGen?

*Live your Secrets and Hive Prosper* 🍯

xx Viki @vikisecrets
👍  , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , and 130 others
properties (23)
authorvikisecrets
permlinkheygen-ai-generated-lip-sync-translations-are-insane-could-completely-replace-dubbing-of-movies-eventually
categoryhive-167922
json_metadata{"app":"peakd/2023.9.2","format":"markdown","tags":["heygen","ai","translation","news","proofofbrain","deutsch","hive-engine","leofinance","movies","technology"],"users":["vikisecrets"],"image":["https://files.peakd.com/file/peakd-hive/vikisecrets/23zGyvTBELFZWSKimVNVPupkw7eoWt741axo5uVy8BuGezKqVWmwTNzSnvCbMis8Nd6V9.png"]}
created2023-09-21 11:15:15
last_update2023-09-21 11:15:15
depth0
children15
last_payout2023-09-28 11:15:15
cashout_time1969-12-31 23:59:59
total_payout_value5.112 HBD
curator_payout_value5.086 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length2,522
author_reputation1,242,803,005,065,466
root_title"HeyGen AI-generated lip-sync translations are insane, could completely replace dubbing of movies eventually"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id127,349,913
net_rshares25,320,647,165,607
author_curate_reward""
vote details (194)
@biyimi ·
Truly AI is changing the world
properties (22)
authorbiyimi
permlinkre-vikisecrets-2023921t145520535z
categoryhive-167922
json_metadata{"tags":["hive-167922","heygen","ai","translation","news","proofofbrain","deutsch","hive-engine","leofinance","movies","technology"],"app":"ecency/3.0.42-mobile","format":"markdown+html"}
created2023-09-21 13:55:21
last_update2023-09-21 13:55:21
depth1
children0
last_payout2023-09-28 13:55:21
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length31
author_reputation110,247,969,247,606
root_title"HeyGen AI-generated lip-sync translations are insane, could completely replace dubbing of movies eventually"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id127,353,024
net_rshares0
@emeraldtiger ·
$0.09
There will be insane competition between video creators, I mean even more than what it currently is !
👍  
properties (23)
authoremeraldtiger
permlinkre-vikisecrets-2023922t93810889z
categoryhive-167922
json_metadata{"tags":["heygen","ai","translation","news","proofofbrain","deutsch","hive-engine","leofinance","movies","technology"],"app":"ecency/3.0.36-vision","format":"markdown+html"}
created2023-09-22 00:38:12
last_update2023-09-22 00:38:12
depth1
children0
last_payout2023-09-29 00:38:12
cashout_time1969-12-31 23:59:59
total_payout_value0.046 HBD
curator_payout_value0.045 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length101
author_reputation21,038,351,163,630
root_title"HeyGen AI-generated lip-sync translations are insane, could completely replace dubbing of movies eventually"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id127,368,134
net_rshares225,942,271,242
author_curate_reward""
vote details (1)
@florakese ·
$0.09
Language academies are going to suffer a lot. 😅
👍  
properties (23)
authorflorakese
permlinkre-vikisecrets-2023921t15251851z
categoryhive-167922
json_metadata{"tags":["heygen","ai","translation","news","proofofbrain","deutsch","hive-engine","leofinance","movies","technology"],"app":"ecency/3.0.36-vision","format":"markdown+html"}
created2023-09-21 13:25:03
last_update2023-09-21 13:25:03
depth1
children0
last_payout2023-09-28 13:25:03
cashout_time1969-12-31 23:59:59
total_payout_value0.046 HBD
curator_payout_value0.047 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length47
author_reputation70,387,985,692,074
root_title"HeyGen AI-generated lip-sync translations are insane, could completely replace dubbing of movies eventually"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id127,352,285
net_rshares236,304,154,150
author_curate_reward""
vote details (1)
@gercripto ·
$0.08
Every day, technology advances more and more, of course, this allows an advance for society and a saving.
It is very good for interpersonal communication.
It will be very good to apply them in the videos so that the information reaches more people in different languages.
 Greetings, @vikisecreets, and many successes.
👍  
properties (23)
authorgercripto
permlinkre-vikisecrets-s1czjd
categoryhive-167922
json_metadata{"tags":["hive-167922"],"app":"peakd/2023.9.2"}
created2023-09-21 23:23:18
last_update2023-09-21 23:23:18
depth1
children0
last_payout2023-09-28 23:23:18
cashout_time1969-12-31 23:59:59
total_payout_value0.042 HBD
curator_payout_value0.042 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length318
author_reputation1,694,125,131,742
root_title"HeyGen AI-generated lip-sync translations are insane, could completely replace dubbing of movies eventually"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id127,366,513
net_rshares210,917,305,094
author_curate_reward""
vote details (1)
@hivebuzz ·
Congratulations @vikisecrets! You have completed the following achievement on the Hive blockchain And have been rewarded with New badge(s)

<table><tr><td><img src="https://images.hive.blog/60x70/http://hivebuzz.me/@vikisecrets/payout.png?202309220033"></td><td>You received more than 43000 HP as payout for your posts, comments and curation.<br>Your next payout target is 44000 HP.<br><sub>The unit is Hive Power equivalent because post and comment rewards can be split into HP and HBD</sub></td></tr>
</table>

<sub>_You can view your badges on [your board](https://hivebuzz.me/@vikisecrets) and compare yourself to others in the [Ranking](https://hivebuzz.me/ranking)_</sub>
<sub>_If you no longer want to receive notifications, reply to this comment with the word_ `STOP`</sub>


To support your work, I also upvoted your post!
properties (22)
authorhivebuzz
permlinknotify-vikisecrets-20230922t003632
categoryhive-167922
json_metadata{"image":["http://hivebuzz.me/notify.t6.png"]}
created2023-09-22 00:36:33
last_update2023-09-22 00:36:33
depth1
children0
last_payout2023-09-29 00:36:33
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length832
author_reputation370,657,106,638,141
root_title"HeyGen AI-generated lip-sync translations are insane, could completely replace dubbing of movies eventually"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id127,368,104
net_rshares0
@itwithsm ·
$0.08
AI is extr ordinary. 
👍  
properties (23)
authoritwithsm
permlinkre-vikisecrets-2023921t221127975z
categoryhive-167922
json_metadata{"tags":["heygen","ai","translation","news","proofofbrain","deutsch","hive-engine","leofinance","movies","technology"],"app":"ecency/3.0.36-vision","format":"markdown+html"}
created2023-09-21 17:11:27
last_update2023-09-21 17:11:27
depth1
children0
last_payout2023-09-28 17:11:27
cashout_time1969-12-31 23:59:59
total_payout_value0.042 HBD
curator_payout_value0.042 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length21
author_reputation200,649,790,305,474
root_title"HeyGen AI-generated lip-sync translations are insane, could completely replace dubbing of movies eventually"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id127,357,930
net_rshares207,056,789,145
author_curate_reward""
vote details (1)
@jfang003 ·
$0.09
I think it's nice to see and it would solve a few of the issues but I am not sure about it's impact on the industry as a whole. I guess it could save time for companies and cut people out of some jobs.
👍  
properties (23)
authorjfang003
permlinkre-vikisecrets-zozfs6dc
categoryhive-167922
json_metadata{"app":"leothreads/0.3","format":"markdown","tags":["leofinance"],"canonical_url":"https://leofinance.io/@jfang003/re-vikisecrets-zozfs6dc","isPoll":false,"pollOptions":{}}
created2023-09-21 17:57:12
last_update2023-09-21 17:57:12
depth1
children0
last_payout2023-09-28 17:57:12
cashout_time1969-12-31 23:59:59
total_payout_value0.047 HBD
curator_payout_value0.047 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length201
author_reputation659,239,722,169,770
root_title"HeyGen AI-generated lip-sync translations are insane, could completely replace dubbing of movies eventually"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id127,358,938
net_rshares236,304,154,150
author_curate_reward""
vote details (1)
@kerrislravenhill ·
$0.08
There will be no need for those movie subtitles anymore with by the flick of a parameter the actor/actress could speak a foreign language. I won't be able to make fun of those Asian to 'Engrish subtitles' anymore.
👍  
properties (23)
authorkerrislravenhill
permlinkre-vikisecrets-2v2drstgw
categoryhive-167922
json_metadata{"app":"leothreads/0.3","format":"markdown","tags":["leofinance"],"canonical_url":"https://leofinance.io/@kerrislravenhill/re-vikisecrets-2v2drstgw","isPoll":false,"pollOptions":{}}
created2023-09-21 22:52:45
last_update2023-09-21 22:52:45
depth1
children0
last_payout2023-09-28 22:52:45
cashout_time1969-12-31 23:59:59
total_payout_value0.042 HBD
curator_payout_value0.042 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length213
author_reputation300,826,247,020,493
root_title"HeyGen AI-generated lip-sync translations are insane, could completely replace dubbing of movies eventually"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id127,365,894
net_rshares211,308,826,838
author_curate_reward""
vote details (1)
@oskarl21 ·
$0.09
HeyGen seems to be making strides in video translation with AI lip synchronization, which is promising. Although there are challenges like artificial-sounding voices and translation issues, in the future, this technology could be valuable for productivity and authenticity in video translation.
👍  ,
properties (23)
authoroskarl21
permlinkre-vikisecrets-s1d5q4
categoryhive-167922
json_metadata{"tags":["hive-167922"],"app":"peakd/2023.9.2"}
created2023-09-22 01:34:57
last_update2023-09-22 01:34:57
depth1
children0
last_payout2023-09-29 01:34:57
cashout_time1969-12-31 23:59:59
total_payout_value0.045 HBD
curator_payout_value0.045 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length294
author_reputation1,916,751,901,886
root_title"HeyGen AI-generated lip-sync translations are insane, could completely replace dubbing of movies eventually"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id127,369,011
net_rshares225,343,363,953
author_curate_reward""
vote details (2)
@qwr ·
 I see  movie or drama in my easy language, there are little mistakes in them like you are pointing in your post 
properties (22)
authorqwr
permlinkre-vikisecrets-2023921t201729439z
categoryhive-167922
json_metadata{"tags":["heygen","ai","translation","news","proofofbrain","deutsch","hive-engine","leofinance","movies","technology"],"app":"ecency/3.0.36-vision","format":"markdown+html"}
created2023-09-21 15:17:30
last_update2023-09-21 15:17:30
depth1
children0
last_payout2023-09-28 15:17:30
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length113
author_reputation18,389,414,476,995
root_title"HeyGen AI-generated lip-sync translations are insane, could completely replace dubbing of movies eventually"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id127,355,143
net_rshares0
@rafzat ·
$0.08
AI is doing a lot and also taking our jobs
I just hope that things go well 
👍  
properties (23)
authorrafzat
permlinkre-vikisecrets-2023921t20049689z
categoryhive-167922
json_metadata{"tags":["hive-167922","heygen","ai","translation","news","proofofbrain","deutsch","hive-engine","leofinance","movies","technology"],"app":"ecency/3.0.42-mobile","format":"markdown+html"}
created2023-09-21 19:00:51
last_update2023-09-21 19:00:51
depth1
children0
last_payout2023-09-28 19:00:51
cashout_time1969-12-31 23:59:59
total_payout_value0.042 HBD
curator_payout_value0.042 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length75
author_reputation183,560,271,702,716
root_title"HeyGen AI-generated lip-sync translations are insane, could completely replace dubbing of movies eventually"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id127,360,744
net_rshares207,468,542,450
author_curate_reward""
vote details (1)
@stayoutoftherz ·
$0.09
Ziemlich beeindruckend!
👍  
properties (23)
authorstayoutoftherz
permlinkre-vikisecrets-s1dtk4
categoryhive-167922
json_metadata{"tags":["hive-167922"],"app":"peakd/2023.9.2"}
created2023-09-22 10:09:42
last_update2023-09-22 10:09:42
depth1
children0
last_payout2023-09-29 10:09:42
cashout_time1969-12-31 23:59:59
total_payout_value0.044 HBD
curator_payout_value0.045 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length23
author_reputation1,362,045,496,698,666
root_title"HeyGen AI-generated lip-sync translations are insane, could completely replace dubbing of movies eventually"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id127,376,648
net_rshares224,752,182,033
author_curate_reward""
vote details (1)
@thebighigg ·
$0.09
It may not be ready quite yet for mass production, give a year or two are translation dub overs will be a thing of the past! Pretty damn cool!
👍  
properties (23)
authorthebighigg
permlinkre-vikisecrets-s1ccbl
categoryhive-167922
json_metadata{"tags":["hive-167922"],"app":"peakd/2023.9.2"}
created2023-09-21 14:59:45
last_update2023-09-21 14:59:45
depth1
children0
last_payout2023-09-28 14:59:45
cashout_time1969-12-31 23:59:59
total_payout_value0.046 HBD
curator_payout_value0.047 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length142
author_reputation525,867,163,407,554
root_title"HeyGen AI-generated lip-sync translations are insane, could completely replace dubbing of movies eventually"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id127,354,644
net_rshares235,836,369,887
author_curate_reward""
vote details (1)
@thehockeyfan-at ·
$0.08
!BBH
👍  
properties (23)
authorthehockeyfan-at
permlinkre-vikisecrets-s1cvlc
categoryhive-167922
json_metadata{"tags":["hive-167922"],"app":"peakd/2023.9.2"}
created2023-09-21 21:56:00
last_update2023-09-21 21:56:00
depth1
children1
last_payout2023-09-28 21:56:00
cashout_time1969-12-31 23:59:59
total_payout_value0.042 HBD
curator_payout_value0.042 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length4
author_reputation101,031,963,950,632
root_title"HeyGen AI-generated lip-sync translations are insane, could completely replace dubbing of movies eventually"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id127,364,809
net_rshares208,289,590,644
author_curate_reward""
vote details (1)
@bbhbot ·
<center><p>@vikisecrets! <b>Your Content Is Awesome</b> so I just sent 1 <b>$BBH</b> (Bitcoin Backed Hive) to your account on behalf of @thehockeyfan-at. <sub>(1/1)</sub></p>
<p><img src="https://i.imgur.com/QwsegY0.png"></p></center>
properties (22)
authorbbhbot
permlinkre-re-vikisecrets-s1cvlc-20230921t215620z
categoryhive-167922
json_metadata"{"app": "beem/0.24.26"}"
created2023-09-21 21:56:21
last_update2023-09-21 21:56:21
depth2
children0
last_payout2023-09-28 21:56:21
cashout_time1969-12-31 23:59:59
total_payout_value0.000 HBD
curator_payout_value0.000 HBD
pending_payout_value0.000 HBD
promoted0.000 HBD
body_length234
author_reputation2,689,790,524,479
root_title"HeyGen AI-generated lip-sync translations are insane, could completely replace dubbing of movies eventually"
beneficiaries[]
max_accepted_payout1,000,000.000 HBD
percent_hbd10,000
post_id127,364,815
net_rshares0