From the ‘video evidence is unreliable’ files: Stanford researchers have employed the latest modern computer vision and graphics software to create a system that can edit pre-recorded videos, in real-time, on a commodity PC.
Our goal is to animate the facial expressions of the target video by a source actor and re-render the manipulated output video in a photo-realistic fashion…[W]e track facial expressions of both source and target video…Reenactment is then achieved by fast and efficient deformation transfer between source and target. The mouth interior that best matches the re-targeted expression is retrieved from the target sequence and warped to produce an accurate fit. Finally, we convincingly re-render the synthesized target face on top of the corresponding video stream such that it seamlessly blends with the real-world illumination. We demonstrate our method in a live setup, where Youtube videos are reenacted in real time.
News media, be on the lookout for incoming pranks!
Link: Face2Face: Real-time Face Capture and Reenactment of RGB Videos
