Abstract
The seam carving technique is one of the most popular techniques for content-aware image retargeting. There have been many attempts to improve existing methods of seam carving to provide more aesthetic retargeting results. However, most previous methods focus on developing an energy map for preserving important image regions while retargeting. Commonly, the existing seam carving based techniques tends to produce discontinuity artifacts when retargeting straight structures. We observe that it occurs when a bunch of seams are assigned across straight structures (i.e., lines or edges). In this paper, we propose a modified seam carving method not only preserving important parts, but also maintaining the prominent structure of the image. To this end, we put a constraint that seams are sparsely assigned each other. Experimental results show that the proposed sparse seam carving yields more plausible retargeting results than previous retargeting approaches and it is very robust to images containing prominent lines or edges.
Similar content being viewed by others
References
Avidan, S., & Shamir, A. (2007). Seam carving for content-aware image resizing. In ACM Transactions on Graphics (TOG). ACM (Vol. 26, p. 10).
Rubinstein, M., Shamir, A., & Avidan, S. (2008). Improved seam carving for video retargeting. In ACM Transactions on Graphics (TOG). ACM (Vol. 27, p.16).
Wang, Y.-S., Tai, C.-L., Sorkine, O., & Lee, T.-Y. (2008). Optimized scale-and-stretch for image resizing. In ACM Transactions on Graphics (TOG). ACM (Vol. 27, p. 118).
Panozzo, D., Weber, O., & Sorkine, O. (2012). Robust image retargeting via axis-aligned deformation. Computer Graphics Forum (proceedings of EUROGRAPHICS), 31(2), 229–236.
Vaquero, D., Turk, M., Pulli, K., Tico, M., & Gelfand, N. (2010). A survey of image retargeting techniques. In SPIE Optical Engineering+ Applications. International Society for Optics and Photonics (pp. 779814–779814).
Sunghwan, C., Bumsub, H., & Kwanghoon, S. (2013). Fast image retargeting via axis-aligned importance scaling. In 20th IEEE International Conference on Image Processing (ICIP) (pp. 1061– 1065).
Zhan, Q., Wang, J., Min, X., & Hanqing, L. (2013). Fusing warping, cropping, and scaling for optimal image thumbnail generation. In Asian Conference on Computer Vision (pp. 445–456): Springer.
Hwang, D.-S., & Chien, S.-Y. (2008). Content-aware image resizing using perceptual seam carving with human attention model. In IEEE International Conference on Multimedia and Expo (ICME) (pp. 1029–1032).
Viola, P., & Jones, M.J. (2004). Robust real-time face detection. International Journal of Computer Vision, 57 (2), 137–154.
Itti, L., Koch, C., & Niebur, E. (1998). A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(11), 1254–1259.
Dong, W., Zhou, N., Paul, J.-C., & Zhang, X. (2009). Optimized image resizing using seam carving and scaling. In ACM Transactions on Graphics (TOG). ACM (Vol. 28, p. 125).
Domingues, D., Alahi, A., & Vandergheynst, P. (2010). Stream carving: An adaptive seam carving algorithm. In IEEE International Conference on Image Processing (ICIP). IEEE (pp. 901–904).
Kiess, J., Kopf, S., Guthier, B., & Effelsberg, W. (2010). Seam carving with improved edge preservation. In IS&T/SPIE Electronic Imaging. International Society for Optics and Photonics (pp. 75420G–75420G).
Jung, C., & Kim, C. (2010). Image retargeting for small display devices. In SPIE Optical Engineering+ Applications. International Society for Optics and Photonics (pp. 77981N–77981N).
Kim, W., Jung, C., & Kim, C. (2011). Spatiotemporal saliency detection and its applications in static and dynamic scenes. IEEE Transactions on Circuits and Systems for Video Technology, 21(4), 446–456.
Kim, W., & Kim, C. (2014). Spatiotemporal saliency detection using textural contrast and its applications. IEEE Transactions on Circuits and Systems for Video Technology, 24(4), 646–659.
Wang, W., Zhai, D., Li, T., & Feng, X. (2014). Salient edge and region aware image retargeting. Signal Processing: Image Communication, 29(10), 1223–1231.
Rubinstein, M., Gutierrez, D., Sorkine, O., & Shamir, A. (2010). A comparative study of image retargeting. In ACM Transactions on Graphics (TOG). ACM (Vol. 29, p. 160).
Liu, T., Yuan, Z., Sun, J., Wang, J., Zheng, N., Tang, X., & Shum, H.-Y. (2011). Learning to detect a salient object. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(2), 353– 367.
Manjunath, B.S., Ohm, J.-R., Vasudevan, V.V., & Yamada, A. (2001). Color and texture descriptors. IEEE Transactions on Circuits and Systems for Video Technology, 11(6), 703–715.
Ma, L., Lin, W., Deng, C., & Ngan, K.N. (2012). Image retargeting quality assessment: A study of subjective scores and objective metrics. IEEE Journal of Selected Topics in Signal Processing, 6(6), 626–639.
Acknowledgments
This work was supported by Hancom, Inc., South Korea, under the project ”Content-based image retargeting/resizing technique development and quality enhancement technology development for camera captured document imaging system.”
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Choi, J., Kim, C. Sparse Seam-Carving for Structure Preserving Image Retargeting. J Sign Process Syst 85, 275–283 (2016). https://doi.org/10.1007/s11265-015-1084-3
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11265-015-1084-3