“Late-Resizing: A Simple but Effective Sketch Extraction Strategy for Improving Generalization of Line-Art Colorization”, 2022 (; similar):
Automatic line-art colorization is a demanding research field owing to its expensive and labor-intensive workload. Learning-based approaches have lately emerged to improve the quality of colorization. To handle the lack of paired data in line art and color images, sketch extraction has been widely adopted. This study primarily focuses on the resizing process applied within the sketch extraction procedure, which is essential for normalizing input sketches of various sizes to the target size of the colorization model.
We first analyze the inherent risk in a conventional resizing strategy, ie. early-resizing, which places the resizing step before the line detection process to ensure the practicality. Although the strategy is extensively used, it involves an often overlooked risk of substantially degrading the generalization of the colorization model. Thus, we propose a late-resizing strategy in which resizing is applied after the line detection step. The proposed late-resizing strategy has 3 advantages: prevention of a quality degradation in the color image, augmentation for downsizing artifacts, and alleviation of look-ahead bias.
In conclusion, we present both quantitative and qualitative evaluations on representative learning-based line-art colorization methods, which verify the effectiveness of the proposed method in the generalization of the colorization model.
See Also:
“Automatic Colorization of Anime Style Illustrations Using a Two-Stage Generator”
“Tag2Pix: Line Art Colorization Using Text Tag With SECat and Changing Loss”
“Line Art Colorization Based on Explicit Region Segmentation”
“Interactive Anime Sketch Colorization with Style Consistency via a Deep Residual Neural Network”
“Deep Edge-Aware Interactive Colorization against Color-Bleeding Effects”