The first film with dubbing artificial intelligence will soon be released in the US

The Swedish sci -fi film uses a technique called Visual Dubbing or “Visual Dubbing” to coordinate the actors’ lips with the English dubbing of the film for the global audience. This is done through artificial intelligence technology and is the first film to be released in the United States.

The Watch the Skies movie with the help of American company Flawless and its TrueSync technology performs the dub. This technology analyzes the actor’s performance and then creates a 3D -view of his face with deep learning techniques, then adjusts his lips in accordance with dubbing words.

TrueSync technology has been available a few years ago and was previously used in Fall’s horror film to correct parts of the film. These sections involved converting offensive words into softer words.

The release of the first film with visual dubbing of artificial intelligence in America

But for Watch the Skies, Flawless technology is used for the full dubbing of the film. The cast has recorded their performance in English in the studio. So their voice will not be manipulated. But the image of the film must change to match the sound.

“We believe the audience will experience the English version of the film without realizing this technical change,” says Albin Peterson, a filmmaker. The result is much better than we expected. “

This technology has a system for managing spiritual rights to ensure that the process of correction of the work with the help of artificial intelligence is performed only with artists’ satisfaction. It is also said that TrueSync can save up to 50 % and prevent the need for re -filming the scenes.

The film Watch the Skies was first shown in 2022. This work is scheduled to be released on May 9 in the United States. The story is about a teenager who, with the help of the UFO observer club, is looking for his lost father, who may have been stolen by foreigners.