Face Swapping: Realistic Image Synthesis Based on Facial Landmarks Alignment

Abstract EN

We propose an image-based face swapping algorithm, which can be used to replace the face in the reference image with the same facial shape and features as the input face.

First, a face alignment is made based on a group of detected facial landmarks, so that the aligned input face and the reference face are consistent in size and posture.

Secondly, an image warping algorithm based on triangulation is presented to adjust the reference face and its background according to the aligned input faces.

In order to achieve more accurate face swapping, a face parsing algorithm is introduced to realize the accurate detection of the face-ROIs, and then the face-ROI in the reference image is replaced with the input face-ROI.

Finally, a Poisson image editing algorithm is adopted to realize the boundary processing and color correction between the replacement region and the original background, and then the final face swapping result is obtained.

In the experiments, we compare our method with other face swapping algorithms and make a qualitative and quantitative analysis to evaluate the reality and the fidelity of the replaced face.

The analysis results show that our method has some advantages in the overall performance of swapping effect.