Shape-from-template
Article
Bartoli, A., Gerard, Y., Chadebecq, F., Collins, T. and Pizarro, D. 2015. Shape-from-template. IEEE Transactions on Pattern Analysis and Machine Intelligence. 37 (10), pp. 2099-2118. https://doi.org/10.1109/TPAMI.2015.2392759
Type | Article |
---|---|
Title | Shape-from-template |
Authors | Bartoli, A., Gerard, Y., Chadebecq, F., Collins, T. and Pizarro, D. |
Abstract | We study a problem that we call Shape-from-Template, which is the problem of reconstructing the shape of a deformable surface from a single image and a 3D template. Current methods in the literature address the case of isometric deformations, and relax the isometry constraint to the convex inextensibility constraint, solved using the so-called maximum depth heuristic. We call these methods zeroth-order since they use image point locations (the zeroth-order differential structure) to solve the shape inference problem from a perspective image. We propose a novel class of methods that we call first-order. The key idea is to use both image point locations and their first-order differential structure. The latter can be easily extracted from a warp between the template and the input image. We give a unified problem formulation as a system of PDEs for isometric and conformal surfaces that we solve analytically. This has important consequences. First, it gives the first analytical algorithms to solve this type of reconstruction problems. Second, it gives the first algorithms to solve for the exact constraints. Third, it allows us to study the well-posedness of this type of reconstruction: we establish that isometric surfaces can be reconstructed unambiguously and that conformal surfaces can be reconstructed up to a few discrete ambiguities and a global scale. In the latter case, the candidate solution surfaces are obtained analytically. Experimental results on simulated and real data show that our isometric methods generally perform as well as or outperform state of the art approaches in terms of reconstruction accuracy, while our conformal methods largely outperform all isometric methods for extensible deformations. |
Publisher | IEEE |
Journal | IEEE Transactions on Pattern Analysis and Machine Intelligence |
ISSN | 0162-8828 |
Electronic | 1939-3539 |
Publication dates | |
Oct 2015 | |
Online | 15 Jan 2015 |
Publication process dates | |
Accepted | 2014 |
Deposited | 28 Feb 2024 |
Output status | Published |
Digital Object Identifier (DOI) | https://doi.org/10.1109/TPAMI.2015.2392759 |
Web of Science identifier | WOS:000360813400012 |
Language | English |
https://repository.mdx.ac.uk/item/z8098
30
total views0
total downloads1
views this month0
downloads this month