Learning to Shadow Hand-Drawn Sketches
Loading...
Links to Files
Author/Creator
Author/Creator ORCID
Date
2020-08-05
Type of Work
Department
Program
Citation of Original Publication
Zheng, Qingyuan; Li, Zhuoru; Bargteil, Adam; Learning to Shadow Hand-Drawn Sketches; 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); https://ieeexplore.ieee.org/document/9156735
Rights
This item is likely protected under Title 17 of the U.S. Copyright Law. Unless on a Creative Commons license, for uses protected by Copyright Law, contact the copyright holder or the author.
Subjects
Abstract
We present a fully automatic method to generate detailed and accurate artistic shadows from pairs of line drawing sketches and lighting directions. We also contribute a new dataset of one thousand examples of pairs of line drawings and shadows that are tagged with lighting directions. Remarkably, the generated shadows quickly communicate the underlying 3D structure of the sketched scene. Consequently, the shadows generated by our approach can be used directly or as an excellent starting point for artists. We demonstrate that the deep learning network we propose takes a hand-drawn sketch, builds a 3D model in latent space, and renders the resulting shadows. The generated shadows respect the hand-drawn lines and underlying 3D space and contain sophisticated and accurate details, such as self-shadowing effects. Moreover, the generated shadows contain artistic effects, such as rim lighting or halos appearing from backlighting, that would be achievable with traditional 3D rendering methods.