-
(单词翻译:双击或拖选)
A start-up company has a tool that it says can recreate lip sync - matching a speaker's lip movements with pre-recorded audio1 - in films.
The artificial2 intelligence, or AI, tool may change how film producers replace recorded speech in a movie with speech recorded in another language. This process is known as dubbing3.
Start-up Flawless AI, co-founded by film director Scott Mann, has a tool that it says can recreate lip sync without changing the performance of the actors.
The tool studies how actors move their mouths. It then changes the movements to sync with the replaced, or dubbed4, words in different languages. The result could be that Tom Hanks looks like he can speak Japanese or Jack5 Nicholson looks like he can speak French.
The idea for the tool came to Mann when he saw how dubbing affected6 his 2015 film "Heist," starring Robert De Niro.
"I hate dubbing as it stands," Mann told Reuters. He went on to describe the problems that dubbing can create. "You have to change so many things to try and catch sync. You're changing words filmmakers and performers have thought about so deeply. They're thrown out to find a different word that fits, but it never really does."
Mann decided7 to do something about this issue.
After some research, he discovered a paper written by Christian8 Theobalt of the Max Planck Institute for Informatics in Germany.
The paper lays out a new method that uses artificial intelligence to recreate human visual effects.
The tool worked to translate a De Niro scene in "Heist." Man said the tool was able to take an 'ooh' sound from De Niro 20 minutes earlier and place that in a different moment in the film."
He added, "It measures at the same time and blends10 it so that the performance is the same, but it's a different mouth movement."
Blend9 is a term that means to mix something, often with good results.
Flawless AI is now working with producers and studios to use the technology after filming is complete. The first films using this tool are around a year away.
Mann believes this technology will help to remove foreign-language categories at award shows. It could create a more open film industry with a real global stage. "From a filmmaking point of view, you're going to see the rise of a much more diverse11 range of stars," he said.
Eventually, Mann hopes the technology's use will be widely accepted. "When it's a common thing, we're not going to think about it anymore and we'll just enjoy the movies," he said.
Words in This Story
lip-sync – n. to pretend to sing (recorded words)
translate – v. to change words from one language into another language
scene – n. a part of a play, movie, story, etc., in which a particular action or activity occurs
category – n. a group of people or things that are similar in some way
diverse – adj. made up of people or things that are different from each other
range – n. a group or collection of different things or people
1 audio | |
n./adj.音频(响)(的);声音(的),听觉(的) | |
参考例句: |
|
|
2 artificial | |
adj.人工的,人造的,人为的;做作的,假装的 | |
参考例句: |
|
|
3 dubbing | |
n.配音v.给…起绰号( dub的现在分词 );把…称为;配音;复制 | |
参考例句: |
|
|
4 dubbed | |
v.给…起绰号( dub的过去式和过去分词 );把…称为;配音;复制 | |
参考例句: |
|
|
5 jack | |
n.插座,千斤顶,男人;v.抬起,提醒,扛举;n.(Jake)杰克 | |
参考例句: |
|
|
6 affected | |
adj.不自然的,假装的 | |
参考例句: |
|
|
7 decided | |
adj.决定了的,坚决的;明显的,明确的 | |
参考例句: |
|
|
8 Christian | |
adj.基督教徒的;n.基督教徒 | |
参考例句: |
|
|
9 blend | |
v.(使)混和,(使)混杂;n.混合物;混和 | |
参考例句: |
|
|
10 blends | |
v.(使)混合( blend的第三人称单数 );(使)混杂;(使)调和;协调 | |
参考例句: |
|
|
11 diverse | |
adj.不同的;相异的;多种多样的;形形色色的 | |
参考例句: |
|
|