Abstract
We present a sketch-based system for modeling 3D objects with multiple contours as overlaid structures, allowing users to infer perceivable symmetries and occluded parts of the model prior to its automatic 3D reconstruction. Many approaches for sketch-based interfaces and modeling focus on the final drawing and 3D reconstruction of solid objects, exploring, as inputs, contours; however, when the subject consists of multiple drawings as overlaid structures, as usual in species descriptions, these approaches have to roughly infer or discard occluded parts. Unlike previous sketch-based techniques, we explore a set of 2D visual effects to enhance the visual perception of users while sketching multiple overlaid objects in single-view. The proposed system was applied to general simple zoological and botanical sketches as well as to published descriptions of species of Diptera, demonstrating its usefulness for taxonomy.
References
Ainsworth, S., Prain, V. & Tytler, R. (2011) Drawing to learn in science. Science, 333 (6046), 1096–1097. https://doi.org/10.1126/science.1204153
Anastacio, F., Sousa, M.C., Samavati, F. & Jorge, J.A. (2006) Modeling plant structures using concept sketches. Proceedings of the 4thInternational Symposium on Non-photorealistic Animation and Rendering, 2006, 105–113. https://doi.org/10.1145/1124728.1124746
Appel, A., Rohlf, F.J. & Stein, A.J. (1979) The haloed line effect for hidden line elimination. Proceedings of the 6th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH, 1979, 151–157. https://doi.org/10.1145/965103.807437
Bartels, R.H. & Samavati, F.F. (2000) Reversing subdivision rules: Local linear conditions and observations on inner products. Journal of Computational and Applied Mathematics, 119 (1–2), 29–67. https://doi.org/10.1016/S0377-0427(00)00370-8
Bessmeltsev, M. (2016) Recovering 3D shape from concept and pose drawings. Ph.D. thesis, University of British Columbia, Vancouver, British Columbia, 134 pp.
Brazil, E.V., Macedo, I., Sousa, M.C., de Figueiredo, L.H. & Velho, L. (2010) Sketching variational hermite-rbf implicits. Proceedings of the Seventh Sketch-Based Interfaces and Modeling Symposium, 2010, 1–8. https://doi.org/10.2312/SBM/SBM10/001-008
Buchanan, P., Mukundan, R. & Doggett, M. (2013) Automatic single-view character model reconstruction. Proceedings of the International Symposium on Sketch-Based Interfaces and Modeling, ACM, 2013, 5–14. https://doi.org/10.1145/2487381.2487385
Burton, M. (2015) Continuous line drawings with overlapping contours. Available form: https://mickburton.co.uk/tag/gordian-knot/ (accessed 29 April 2021)
Chen, S.Y., Su, W., Gao, L., Xia, S. & Fu, H. (2020) DeepFaceDrawing: deep generation of face images from sketches. Proceedings of ACM SIGGRAPH, 39 (4), Article 72, 16. https://doi.org/10.1145/3386569.3392386
Chen, W. & Hays, J. (2018) SketchyGAN: Towards diverse and realistic sketch to image synthesis. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, 416–9425. https://doi.org/10.1109/CVPR.2018.00981
Cherlin, J.J., Samavati, F., Sousa, M.C. & Jorge, J.A. (2005) Sketch-based modeling with few strokes. Proceedings of the 21st spring conference on Computer Graphics, ACM, 137–145. https://doi.org/10.1145/1090122.1090145
De Paoli, C. & Singh, K. (2015) Secondskin: Sketch-based construction of layered 3D models. ACM Transactions on Graphics (TOG), 34 (4), Article 126, 1–10. https://doi.org/10.1145/2766948
Dvoroznak, M., Sykora, D., Curtis, C., Curless, B., Sorkine-Hornung, O. & Salesin, D. (2020) Monster Mash: A single-view approach to casual 3D modeling and animation. ACM Transactions on Graphics (TOG), 39 (6), 1–12. https://doi.org/10.1145/3414685.3417805
Entem, E., Barthe, L., Cani, M.P., Cordier, F. & Van De Panne, M. (2015) Modeling 3D animals from a side-view sketch. Computers and Graphics, 46, 221–230. https://doi.org/10.1016/j.cag.2014.09.037
Everts, M.H., Bekker, H., Roerdink, J.B. & Isenberg, T. (2009) Depth-dependent halos: Illustrative rendering of dense line data. IEEE Transactions on Visualization and Computer Graphics, 15 (6), 1299–1306. https://doi.org/10.1109/TVCG.2009.138
Fachin, D.A., Santos, C.M.D. & Amorim, D. (2018) First two species of Austroleptis Hardy (Diptera: Brachycera: Austroleptidae) from Brazil. Zootaxa, 4369 (4), 557–574. https://doi.org/10.11646/zootaxa.4369.4.6
Fine, I., Wade, A.R., Brewer, A.A., May, M.G., Goodman, D.F., Boynton, G.M., Wandell, B.A. & MacLeod, D.I.A. (2003) Long-term deprivation affects visual perception and cortex. Nature Neuroscience, 6 (9), 915–916. https://doi.org/10.1038/nn1102
Fish, A. & Lisitsa, A. (2014) Detecting unknots via equational reasoning, i: Exploration. In: Watt, S.M., Davenport, J.H., Sexton, A.P., Sojka, P. & Urban, J. (Eds.), Intelligent Computer Mathematics. CICM 2014. Lecture Notes in Computer Science. Vol. 8543. Springer, Cham, pp. 76–91. https://doi.org/10.1007/978-3-319-08434-3_7
Ghosh, A., Zhang, R., Dokania, P.K., Wang, O., Efros, A.A., Torr, P.H. & Shechtman, E. (2019) Interactive sketch & fill: Multiclass sketch-to-image translation. Proceedings of the IEEE International Conference on Computer Vision, 2019, 1171–1180. https://doi.org/10.1109/ICCV.2019.00126
Gois, J.P., Trevisan, D.F., Batagelo, H.C., Macedo, I. (2013) Generalized Hermitian radial basis functions implicits from polygonal mesh constraints. The Visual Computer, 29 (6), 651–661. https://doi.org/10.1007/s00371-013-0802-8
Gooch, A., Gooch, B., Shirley, P. & Cohen, E. (1998) A non-photorealistic lighting model for automatic technical illustration. Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH, 1998, 447–452. https://doi.org/10.1145/280814.280950
Hodges, E.R. (2003) The guild handbook of scientific illustration. John Wiley & Sons, Hoboken, NJ.
Igarashi, T., Matsuoka, S. & Tanaka, H. (1999) Teddy: a sketching interface for 3D freeform design. ACM SIGGRAPH, 1999, 409–416. https://doi.org/10.1145/311535.311602
Igarashi, T. & Mitani, J. (2010) Apparent layer operations for the manipulation of deformable objects. ACM Transactions on Graphics (TOG), 29 (4), Article 110, 1–7. https://doi.org/10.1145/1778765.1778847
Jayaraman, P.K., Fu, C.W., Zheng, J., Liu, X. & Wong, T.T. (2018) Globally consistent wrinkle-aware shading of line drawings. IEEE Transactions on Visualization and Computer Graphics, 24 (7), 2103–2117. https://doi.org/10.1109/TVCG.2017.2705182
Kaplan, M., Gooch, B. & Cohen, E. (2000) Interactive artistic rendering. Proceedings of the first International Symposium on Non Photorealistic Animation and Rendering, 2000, 67–74. https://doi.org/10.1145/340916.340925
Kazmi, I.K., You, L. & Zhang, J.J. (2014) A survey of sketch based modeling systems. IEEE 11th International Conference on Computer Graphics, Imaging and Visualization, 2014, 14696717. https://doi.org/10.1109/CGiV.2014.27
Landin, J. (2015) Rediscovering the forgotten benefits of drawing. Scientific American Blog, 4 September 2010. Available from: https://blogs.scientificamerican.com/symbiartic/rediscovering-the-forgotten-benefits-of-drawing/ (accessed 16 August 2021)
Li, C., Pan, H., Liu, Y., Tong, X., Sheffer, A. & Wang, W. (2017) Bendsketch: Modeling freeform surfaces through 2D sketching. ACM Transactions on Graphics (TOG), 36 (4), Article 125, 1–14. https://doi.org/10.1145/3072959.3073632
Li, W., Ritter, L., Agrawala, M., Curless, B. & Salesin, D. (2007) Interactive cutaway illustrations of complex 3D models. ACM Transactions on Graphics (TOG), 26 (3), 31. https://doi.org/10.1145/1276377.1276416
Merkle, B.G. (2018) Drawn to science. Nature, 562, S8–S9.
https://doi.org/10.1038/d41586-018-06832-0
Mollica, P. (2013) Color theory: An essential guide to color-from basic principles to practical applications. Walter Foster, Laguna Hills, California, 64 pp.
Olsen, L., Samavati, F.F., Sousa, M.C. & Jorge, J.A. (2009) Sketch-based modeling: A survey. Computers & Graphics, 33 (1), 85–103. https://doi.org/10.1016/j.cag.2008.09.013
Ramos, S., Trevisan, D.F., Batagelo, H.C., Sousa, M.C. & Gois, J.P. (2018) Contour-aware 3D reconstruction of side-view sketches. Computers & Graphics, 77, 97–107. https://doi.org/10.1016/j.cag.2018.09.009
Samavati, F.F. & Bartels, R.H. (2004) Local filters of b-spline wavelets. Proceedings of the International Workshop on Biometric Technologies, 2004, 105–110.
Santos, C.M.D. & Amorim, D.S. (2007) Chrysopilus (Diptera: Rhagionidae) from Brazil: Redescription of Chrysopilus fascipennis Bromley and description of eleven new species. Zootaxa, 1510 (1), 1–33. https://doi.org/10.11646/zootaxa.1510.1.1
Shen, I.C., Liu, K.H., Su, L.W., Wu, Y.T. & Chen, B.Y. (2020) Clipflip: Multi-view clipart design. Computer Graphics Forum, 40 (1), 327–340. https://doi.org/10.1111/cgf.14190
Sousa, M.C., Foster, K., Wyvill, B. & Samavati, F. (2003) Precise Ink Drawing of 3D Models Computer Graphics Forum, 22 (3), 369–379. https://doi.org/10.1111/1467-8659.00684
Sykora, D., Kavan, L., Cadik, M., Jamriska, O., Jacobson, A., Whited, B., Simmons, M. & Sorkine-Hornung, O. (2014) Ink-and-ray: Bas-relief meshes for adding global illumination effects to hand-drawn characters. ACM Transactions on Graphics (TOG), 33 (2), Article 16, 1–15. https://doi.org/10.1145/2591011
Todd, J.T. (2004) The visual perception of 3D shape. Trends in Cognitive Sciences, 8 (3), 115–121. https://doi.org/10.1016/j.tics.2004.01.006
Yeh, C.K., Song, P., Lin, P.Y., Fu, C.W., Lin, C.H. & Lee, T.Y. (2013) Double-sided 2.5 D graphics. IEEE Transactions on Visualization and Computer Graphics, 19 (2), 225–235. https://doi.org/10.1109/TVCG.2012.116
Zander, J., Isenberg, T., Schlechtweg, S. & Strothotte, T. (2004) High quality hatching. Computer Graphics Forum, 23 (3), 421–430. https://doi.org/10.1111/j.1467-8659.2004.00773.x
Zhu, L., Igarashi, T. & Mitani, J. (2013) Soft folding. Computer Graphics Forum, 32 (7), 167–176. https://doi.org/10.1111/cgf.12224