Robust Semiautomatic 2D-to-3D Conversion with Welsch M-Estimator for Data Fidelity

Abstract EN

Semiautomatic 2D-to-3D conversion plays an important role in generating 3D contents for display.

However, most existing methods assume that user scribbles are perfectly correct, and only give acceptable results when user provides accurate labels.

To address this problem, Welsch M-estimator data fidelity is used to resist erroneous scribbles.

The Welsch M-estimator data fidelity which is able to alleviate the influence of inaccurate scribbles has theoretical guarantee by means of its redescending property.

First, the Welsch M-estimator is introduced to measure the fidelity between estimated depth and user provided depth; then local smoothness is built by using color weighted Welsch M-estimator to make neighboring pixels with similar colors have similar depth values.

Finally, we solve the problem using generalized iteratively reweighted least squares algorithm.

Experiments demonstrate that our method obtains competitive performance in the absence of inaccurate scribbles and outperforms the state of the art both visually and quantitatively in the presence of inaccurate scribbles.