From image parsing to painterly rendering
- 15 December 2009
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 29 (1) , 1-11
- https://doi.org/10.1145/1640443.1640445
Abstract
We present a semantics-driven approach for stroke-based painterly rendering, based on recent image parsing techniques [Tu et al. 2005; Tu and Zhu 2006] in computer vision. Image parsing integrates segmentation for regions, sketching for curves, and recognition for object categories. In an interactive manner, we decompose an input image into a hierarchy of its constituent components in a parse tree representation with occlusion relations among the nodes in the tree. To paint the image, we build a brush dictionary containing a large set (760) of brush examples of four shape/appearance categories, which are collected from professional artists, then we select appropriate brushes from the dictionary and place them on the canvas guided by the image semantics included in the parse tree, with each image component and layer painted in various styles. During this process, the scene and object categories also determine the color blending and shading strategies for inhomogeneous synthesis of image details. Compared with previous methods, this approach benefits from richer meaningful image semantic information, which leads to better simulation of painting techniques of artists using the high-quality brush dictionary. We have tested our approach on a large number (hundreds) of images and it produced satisfactory painterly effects.Keywords
Funding Information
- Division of Information and Intelligent Systems (IIS-0713652)
- Ministry of Science and Technology of the People's Republic of China (2007AA01Z3402008AA01Z126)
- National Natural Science Foundation of China (60672162)
This publication has 25 references indexed in Scilit:
- Primal sketch: Integrating structure and textureComputer Vision and Image Understanding, 2007
- Color harmonizationACM Transactions on Graphics, 2006
- Parsing Images into Regions, Curves, and Curve GroupsInternational Journal of Computer Vision, 2006
- Animating Chinese paintings through stroke-based decompositionACM Transactions on Graphics, 2006
- MoXiACM Transactions on Graphics, 2005
- Image Parsing: Unifying Segmentation, Detection, and RecognitionInternational Journal of Computer Vision, 2005
- Lazy snappingACM Transactions on Graphics, 2004
- Mean shift: a robust approach toward feature space analysisPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Color transfer between imagesIEEE Computer Graphics and Applications, 2001
- Orientation diffusionsIEEE Transactions on Image Processing, 1998