Authors
Elena Garces, Victor Arellano, Carlos Rodriguez-Pardo, David Pascual, Sergio Suja, Jorge Lopez-Moreno
Universidad Rey Juan Carlos; SEDDI
Portals
Abstract
Existing devices for measuring material appearance in spatially-varying samples are limited to a single scale, either micro or mesoscopic. This is a practical limitation when the material has a complex multi-scale structure. In this paper, we present a system and methods to digitize materials at two scales, designed to include high-resolution data in spatially-varying representations at larger scales. We design and build a hemispherical light dome able to digitize flat material samples up to 11x11cm. We estimate geometric properties, anisotropic reflectance and transmittance at the microscopic level using polarized directional lighting with a single orthogonal camera. Then, we propagate this structured information to the mesoscale, using a neural network trained with the data acquired by the device and image-to-image translation methods. To maximize the compatibility of our digitization, we leverage standard BSDF models commonly adopted in the industry. Through extensive experiments, we demonstrate the precision of our device and the quality of our digitization process using a set of challenging real-world material samples and validation scenes. Further, we demonstrate the optical resolution and potential of our device for acquiring more complex material representations by capturing microscopic attributes which affect the global appearance: we characterize the properties of textile materials such as the yarn twist or the shape of individual fly-out fibers. We also release the SEDDIDOME dataset of materials, including raw data captured by the machine and optimized parameteres.
Contribution
- A custom-built optical capture system for capturing reflectance properties at both micro and meso scale, capable of acquiring, in an end-to-end pipeline, anisotropic reflectance, transmittance, and micro-level details
- We evaluate different design choices and optimization approaches to estimate a standard physically-based microfacet SVBSDF, including anisotropy and transmittance parameters
- We evaluate our digital materials by comparing them to realworld scenes with different lighting conditions.
- The SEDDIDOME dataset that contains 36 materials with raw captured data and optimized parameters
Related Works
Rigid Capture Devices; Lightweight Capture Systems; Fiber-Level Capture; Translucency