In Proceedings of SIGGRAPH (Conference Paper Track)

Metameric: Spectral Uplifting via Controllable Color Constraints

Mark van de Ruit and Elmar Eisemann

Left. Spectral renderings of the same scene under four standard illuminants. This scene contains RGB textures which have been authored for spectral uplifting with our method. Top-right. Metameric mismatching between two objects, which are constrained to remain identical under D65 and A illuminants. Middle-right. Metamerism on a surface with exaggerated reflectances constrained to the theoretical boundaries of a metamer mismatch volume, such that a message becomes visible only under the FL11 illuminant. Bottom-right. A more realistic example of generated spectral reflectances using our method.

Spectral rendering is a crucial solution for photorealistic rendering. However, most available texture assets are RGB-only, and access to spectral content is limited. Uplifting methods that recover full spectral representations from RGB inputs have therefore received much attention. Yet, most methods are deterministic, while, in reality, there is no one-to-one mapping. As a consequence, the appearance of uplifted textures is fully determined under all illuminants. Hereby, metamers, which are materials with differing spectral responses that appear identical under a specific illumination, are excluded. We propose a method which makes this uplifting process controllable. Hereby, a user can define texture appearance under various lighting conditions, leading to a greatly increased flexibility for content design. Our method determines the space of possible metameric manipulations and enables interactive adjustments, while maintaining a set of user-specified appearance constraints. To achieve this goal, we formulate the problem as a constrained optimization, building upon an interpolation scheme and data-based reflectance generation, which maintain plausibility. Besides its value for artistic control, our solution is lightweight and can be executed on the fly, which keeps its memory consumption low and makes it easy to integrate into existing frameworks.


More Information

Citation

Mark van de Ruit and Elmar Eisemann, Metameric: Spectral Uplifting via Controllable Color Constraints, In Proceedings of SIGGRAPH (Conference Paper Track), pp. 42:1–42:10, 2023.

BibTex

@inproceedings{bib:van de ruit:2023,
    author       = { van de Ruit, Mark and Eisemann, Elmar },    
    title        = { Metameric: Spectral Uplifting via Controllable Color Constraints },
    booktitle    = { In Proceedings of SIGGRAPH (Conference Paper Track) },
    year         = { 2023 },
    pages        = { 42:1--42:10 },
    doi          = { 10.1145/3588432.3591565 },
    dblp         = { conf/siggraph/RuitE23 },
    url          = { https://publications.graphics.tudelft.nl/papers/72 },
}