Interactive BRDF Estimation for Mixed-Reality Applications

Information

• Publication Type: Journal Paper with Conference Talk
• Workgroup(s)/Project(s):
  • Reciprocal Shading for Mixed Reality
• Date: June 2012
• Journal: Journal of WSCG
• Volume: 20
• Number: 1
• Location: Plzen, Czech Republic
• Lecturer: Martin Knecht
• ISSN: 1213-6972
• Event: WSCG 2012
• Conference date: 25. June 2012 – 28. June 2012
• Pages: 47 – 56
• Keywords: Augmented Reality, BRDF Estimation, Reconstruction

Abstract

Recent methods in augmented reality allow simulating mutual light interactions between real and virtual objects. These methods are able to embed virtual objects in a more sophisticated way than previous methods. However, their main drawback is that they need a virtual representation of the real scene to be augmented in the form of geometry and material properties. In the past, this representation had to be modeled in advance, which is very time consuming and only allows for static scenes.

We propose a method that reconstructs the surrounding environment and estimates its Bidirectional Reflectance Distribution Function (BRDF) properties at runtime without any preprocessing. By using the Microsoft Kinect sensor and an optimized hybrid CPU & GPU-based BRDF estimation method, we are able to achieve interactive frame rates. The proposed method was integrated into a differential instant radiosity rendering system to demonstrate its feasibility.

Additional Files and Images

Weblinks

No further information available.

BibTeX

@article{knecht_martin_2012_BRDFEstimation,
  title =      "Interactive BRDF Estimation for Mixed-Reality Applications",
  author =     "Martin Knecht and Georg Tanzmeister and Christoph Traxler
               and Michael Wimmer",
  year =       "2012",
  abstract =   "Recent methods in augmented reality allow simulating mutual
               light interactions between real and virtual objects. These
               methods are able to embed virtual objects in a more
               sophisticated way than previous methods. However, their main
               drawback is that they need a virtual representation of the
               real scene to be augmented in the form of geometry and
               material properties. In the past, this representation had to
               be modeled in advance, which is very time consuming and only
               allows for static scenes.  We propose a method that
               reconstructs the surrounding environment and estimates its
               Bidirectional Reflectance Distribution Function (BRDF)
               properties at runtime without any preprocessing. By using
               the Microsoft Kinect sensor and an optimized hybrid CPU &
               GPU-based BRDF estimation method, we are able to achieve
               interactive frame rates. The proposed method was integrated
               into a differential instant radiosity rendering system to
               demonstrate its feasibility.",
  month =      jun,
  journal =    "Journal of WSCG",
  volume =     "20",
  number =     "1",
  issn =       "1213-6972",
  pages =      "47--56",
  keywords =   "Augmented Reality, BRDF Estimation, Reconstruction",
  URL =        "https://www.cg.tuwien.ac.at/research/publications/2012/knecht_martin_2012_BRDFEstimation/",
}