Real-time face capture and reenactment of videos

Our goal is to animate the facial expressions of the target video by a source actor and re-render the manipulated output video in a photo-realistic fashion. To this end, we first address the under-constrained problem of facial identity recovery from monocular video by non-rigid model-based bundling. At run time, we track facial expressions of both source and target video using a dense photometric consistency measure. Reenactment is then achieved by fast and efficient deformation transfer between source and target. The mouth interior that best matches the re-targeted expression is retrieved from the target sequence and warped to produce an accurate fit. Finally, we convincingly re-render the synthesized target face on top of the corresponding video stream such that it seamlessly blends with the real-world illumination. We demonstrate our method in a live setup, where Youtube videos are reenacted in real time.

https://www.rt.com/viral/336379-change-face-trump-putin/

The development, which is as equally impressive as it is disturbing, is the result of a collaboration between researchers from Germany’s University of Erlangen-Nuremberg, the Max-Planck Institute for Informatics, and Stanford University in California.

The study, Face2Face: Real-time Face Capture and Reenactment of RGB Videos,
“animates the facial expressions of the target video by a source actor and re-renders the manipulated output video in a photo-realistic fashion,” according to the researchers.

———–

thanks to xxx for the link..

now this is sort of scary and disturbing..just think of the possibilities..and this can also be done retrospectively on old video and footage as we can see from the examples in the video..the mind boggles at what could be achieved..and if we are finding out about it now..how long has it been a tool of the controllers?

401

~ by seeker401 on March 23, 2016.

4 Responses to “Real-time face capture and reenactment of videos”

  1. […] Source: Real-time face capture and reenactment of videos […]

  2. As if the illusion we already live in is not bad enough, technology and Progress seem to destroy more than they help or uplift humanity.

  3. do you remember the oprah trump video from a few days ago? his mouth looked weird in that

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

 
%d bloggers like this: