Domaine thématique du pôle

- Image Son Interactivité

Titre du projet

High-Fidelity Image-Based Modeling and Rendering :
Programme blanc

Contact Porteur

univ.

Contact Mail

segonne@certis.enpc.fr

Résumé

Il existe un besoin grandissant de "contenu" tri-dimensionnel (3D) dans le domaine des loisirs, de l'ingénierie et de la science. Nous proposons de mener des recherches en vision par ordinateur avec pour objectif de développer des logiciels perfectionnés de modélisation 3D à partir d'images, ce qui fera des appareils photos et des caméras grand public des capteurs 3D flexibles, précis et peu coûteux. Concrètement, nous axerons notre recherche sur la modélisation et le rendu 3D de haute précision à partir d'images, et nous proposerons des applications des technologies développées dans le cadre de ce projet à la post-production cinématographique, aux effets spéciaux et à la conservation de l'héritage culturel, par le biais de collaborations avec des partenaires extérieurs.

Objectif Général

There is an increasing need for three-dimensional (3D) “content" in entertainment, engineering, and scientific applications. We predict that, for most of these, today's specialized 3D sensors will eventually be replaced by ordinary, consumer-grade digital cameras equipped with advanced image-based modeling and analysis software. We propose core computer vision and computer graphics research that will enable the development of this software and its application to real-world problems.

Objectif Sectoriel

Concretely, we will focus on high-fidelity image-based modeling and 3D shape and appearance matching. We will focus on the following three problems:
1) Core image-based modeling. We propose a novel approach to calibrated multi-view, wide-baseline stereopsis, as a core technology for image-based modeling.
2) Physical and statistical shape models. We propose to construct realistic physical and statistical models of object shape and appearance and to integrate them as priors into the image-based modeling and rendering process.
3) Advanced image-based rendering. We focus on the efficient and realistic rendering of image-based models integrated inside classical geometrical scenes, including lighting, shadowing and re-lighting effects.

Philosophie / Démarche

We believe that the emergence of consumer-grade digital cameras that match (and may soon exceed) the resolution and image quality of argentic ones is a tremendous opportunity to develop advanced image-based modeling and analysis software that will turn these cameras into flexible, affordable and accurate 3D sensors, and allow the widespread acquisition and use of 3D content in engineering and scientific applications. We propose computer vision and computer graphics research that will enable the development of this software.