Abstract
We present a novel approach for interactive content-aware image resizing. The resizing is performed on warping a triangular mesh over the image, which captures the image saliency information as well as the underlying image features. The warped triangular mesh and the horizontal and vertical scales of all triangles are simultaneously obtained by a quadratic optimization which can be achieved by solving a sparse linear system. Our approach can preserve the shapes of curved features in the resized images. The resizing operation can be performed in an interactive rate which makes the proposed approach practically useful for realtime image resizing. To guarantee a foldover free resizing result, we modify the optimization to a standard quadratic programming. A number of experimental results have shown that our approach has obtained pleasing results and outperforms the previous approaches.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Avidan, S., Shamir, A.: Seam carving for content-aware image resizing. ACM Trans. Graph. 26(3), 267–276 (2007) (Proc. SIGGRAPH)
Barnes, C., Shechtman, E., Finkelstein, A., Goldman, D.: PatchMatch: a randomized correspondence algorithm for structural image editing. ACM Trans. Graph. 28(3) (2009) (Proc. SIGGRAPH)
Canny, J.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 8(6), 679–698 (1986)
Dong, W., Zhou, N., Paul, J.-C., Zhang, X.: Optimized image resizing using seam carving and scaling. ACM Trans. Graph. 28(5) (2009) (Proc. SIGGRAPH Asia)
Fernandes, L., Oliveira, M.: Real-time line detection through improved hough transform voting scheme. Pattern Recogn. 41(1), 299–314 (2008)
Grant, M., Boyd, S., Ye, Y.: CVX: Matlab software for disciplined convex programming. http://www.stanford.edu/~boyd/cvx
Guo, Y., Liu, F., Shi, J., Zhou, Z., Gleicher, M.: Image retargeting using mesh parametrization. IEEE Trans. Multimed. 11(5), 856–867 (2009)
Harel, J., Koch, C., Perona, P.: Graph-based visual saliency. In: Proc. Neural Information Processing Systems (NIPS), vol. 19, pp. 545–552 (2006)
Intel math kernel library (2010). http://developer.intel.com
Karni, Z., Freedman, D., Gotsman, C.: Energy-based content-aware image deformation. Comput. Graph. Forum 28(5), 1257–1268 (2009) (Proc. Symposium on Geometry Processing)
Kim, H., Kumara, S.: New quality metrics for digital image resizing. Proc. SPIE 6696, 669608 (2007)
Liu, L., Zhang, L., Xu, Y., Gotsman, C., Gortler, S.J.: A local/global approach to mesh parameterization. Comput. Graph. Forum 27(5), 1495–1504 (2008) (Proc. Symposium on Geometry Processing)
Pritch, Y., Kav-Venaki, E., Peleg, S.: Shift-map image editing. In: Proc. of ICCV (2009)
Reibman, A., Suthaharan, S.: A no-reference spatial aliasing measure for digital image resizing. In: Proc. ICIP, pp. 1184–1187 (2008)
Rubinstein, M., Shamir, A., Avidan, S.: Improved seam carving for video retargeting. ACM Trans. Graph. 27(3), 1–9 (2008) (Proc. SIGGRAPH)
Rubinstein, M., Shamir, A., Avidan, S.: Multi-operator media retargeting. ACM Trans. Graph. 28(3), 1–11 (2009) (Proc. SIGGRAPH)
Sederberg, T.W., Gao, P., Wang, G., Mu, H.: 2D shape blending: an intrinsic solution to the vertex path problem. In: Proc. SIGGRAPH, pp. 15–18 (1993)
Seidel, R.: Constrained Delaunay triangulations and Voronoi diagrams with obstacles. Technical Report, Inst. for Information Processing, Graz, Austria (1988)
Shamir, A., Sorkine, O.: Visual media retargeting. In: SIGGRAPH Asia Course (2009)
Sorkine, O., Lipman, Y., Cohen-Or, D., Alexa, M., Rossl, C., Seidel, H.-P.: Laplacian surface editing. In: Proc. Symposium on Geometry Processing, pp. 179–188 (2004)
Wang, Y.-S., Tai, C.L., Sorkine, O., Lee, T.-Y.: Optimized scale-and-stretch for image resizing. ACM Trans. Graph. 27(5), 1–8 (2008) (Proc. SIGGRAPH Asia)
Wolf, L., Guttmann, M., Cohen-Or, D.: Nonhomogeneous content-driven video-retargeting. In: Proc. ICCV, pp. 1–6 (2007)
Zhang, L., Liu, L., Gotsman, C., Gortler, S.J.: An as-rigid-as-possible approach to sensor network localization. ACM Trans. Sens. Netw. 6(4), 1–12 (2010)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Jin, Y., Liu, L. & Wu, Q. Nonhomogeneous scaling optimization for realtime image resizing. Vis Comput 26, 769–778 (2010). https://doi.org/10.1007/s00371-010-0472-8
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-010-0472-8