Authors
Yiwei Hu, Milo
Yale University; Adobe Research
Portals
Abstract
Despite the ubiquitousness of materials maps in modern rendering pipelines, their editing and control remains a challenge. In this paper, we present an example-based material control method to augment input material maps based on user-provided material photos. We train a tileable version of MaterialGAN and leverage its material prior to guide the appearance transfer, optimizing its latent space using differentiable rendering. Our method transfers the micro and meso-structure textures of user provided target(s) photographs, while preserving the structure of the input and quality of the input material. We show our methods can control existing material maps, increasing realism or generating new, visually appealing materials.
Contribution
- A material transfer method for controlling appearance of material maps using photo(s)
- MaterialGAN as a prior for tileable materials appearance transfer
- A multi-target transfer option with fine region control
Related Works
Material Appearance Control; Style Transfer; Procedural Material Modeling; Material Acquisition
Comparisons
Overview
We propose a method to control and improve the appearance of an existing material (left) by transferring the appearance of materials in one or multiple target photo(s) (center) to the existing material. The augmented material (right) combines the coarse structure from the original material with the fine-scale appearance of the target(s) and preserve the input tileability. Our method can also transfer appearance from materials from different types by spatial control. This enables a simple workflow to make existing materials more realistic using readily-available images or photos.