Abstract
In this paper, the minimax problems with inequality constraints are discussed, and an alternative fast convergent method for the discussed problems is proposed. Compared with the previous work, the proposed method has the following main characteristics. First, the active set identification which can reduce the scale and the computational cost is adopted to construct the direction finding subproblems. Second, the master direction and high-order correction direction are computed by solving a new type of norm-relaxed quadratic programming subproblem and a system of linear equations, respectively. Third, the step size is yielded by a new line search which combines the method of strongly sub-feasible direction with the penalty method. Fourth, under mild assumptions without any strict complementarity, both the global convergence and rate of superlinear convergence can be obtained. Finally, some numerical results are reported.
Similar content being viewed by others
References
Zhou, J.L., Tits, A.L.: Nonmonotone line search for minimax problems. J. Optim. Theory Appl. 76, 455–476 (1993)
Rustem, B., Nguyen, Q.: An algorithm for the inequality-constrained discrete minimax problem. SIAM J. Optim. 8, 265–283 (1998)
Yu, Y.H., Gao, L.: Nonmonotone line search algorithm for constrained minimax problems. J. Optim. Theory Appl. 115, 419–446 (2002)
Jian, J.B., Quan, R., Zhang, X.L.: Feasible generalized monotone line search SQP algorithm for nonlinear minimax problems with inequality constraints. J. Comput. Appl. Math. 205, 406–429 (2007)
Reemtsen, R.: A cutting plane method for solving minimax problems in the complex plane. Numer. Algorithms 2, 409–436 (1992)
Xu, S.: Smoothing method for minimax problems. Comput. Optim. Appl. 20, 267–279 (2001)
Polak, E., Womersley, R.S., Yin, H.X.: An algorithm based on active sets and smoothing for discretized semi-infinite minimax problems. J. Math. Anal. Appl. 138, 311–328 (2008)
Zhu, Z.B., Cai, X., Jian, J.B.: An improved SQP algorithm for solving minimax problems. Appl. Math. Lett. 22, 464–469 (2009)
Jian, J.B., Zhang, X.L., Quan, R., Ma, Q.: Generalized monotone line search SQP algorithm for constrained minimax problems. Optimization 58, 101–131 (2009)
Han, D.L., Jian, J.B., Li, J.: On the accurate identification of active set for constrained minimax problems. Nonlinear Anal., Real World Appl. 74, 3022–3032 (2011)
Royset, J.O., Pee, E.Y.: Rate of convergence analysis of discretization and smoothing algorithms for semi-infinite minimax problems. J. Optim. Theory Appl. 155, 855–882 (2012)
Bagirov, A.M., Al Nuaimat, A., Sultanova, N.: Hyperbolic smoothing function method for minimax problems. Optimization 62, 759–782 (2013)
Hare, W., Macklem, M.: Derivative-free optimization methods for finite minimax problems. Optim. Methods Softw. 28, 300–312 (2013)
Hare, W., Nutini, J.: A derivative-free approximate gradient sampling algorithm for finite minimax problems. Comput. Optim. Appl. 56, 1–38 (2013)
Wang, F.S.: A hybrid algorithm for linearly constrained minimax problems. Ann. Oper. Res. 206, 501–525 (2013)
Jian, J.B., Mo, X.D., Qiu, L.J., Yang, S.M., Wang, F.S.: Simple sequential quadratically constrained quadratic programming feasible algorithm with active identification sets for constrained minimax problems. J. Optim. Theory Appl. (2013, in press). doi:10.1007/s10957-013-0339-z
Zoutendijk, G.: Methods of Feasible Directions. Elsevier, Amsterdam (1960)
Topkis, D.M., Veinott, A.F.: On the convergence of some feasible direction algorithms for nonlinear programming. SIAM J. Control 5, 268–279 (1967)
Pironneau, O., Polak, E.: Rate of convergence of a class of methods of feasible directions. SIAM J. Numer. Anal. 10, 161–173 (1973)
Cawood, M.E., Kostreva, M.M.: Norm-relaxed method of feasible direction for solving the nonlinear programming problems. J. Optim. Theory Appl. 83, 311–320 (1994)
Chen, X., Kostreva, M.M.: A generalization of the norm-relaxed method of feasible directions. Appl. Math. Comput. 102, 257–273 (1999)
Kostreva, M.M., Chen, X.: A superlinearly convergent method of feasible directions. Appl. Math. Comput. 116, 231–244 (2000)
Lawrence, C.T., Tits, A.L.: A computationally efficient feasible sequential quadratic programming algorithm. SIAM J. Optim. 11, 1092–1118 (2001)
Chen, X., Kostreva, M.M.: Global convergence analysis of algorithm for finding feasible points in norm-relaxed method of feasible directions. J. Optim. Theory Appl. 100, 287–309 (1999)
Jian, J.B.: Strong combined Phase I–Phase II methods of sub-feasible directions. Math. Econ. 12, 64–70 (1995) (in Chinese)
Jian, J.B., Zheng, H.Y., Hu, Q.J., Tang, C.M.: A new norm-relaxed method of strongly sub-feasible direction for inequality constrained optimization. Appl. Math. Comput. 168, 1–28 (2005)
Jian, J.B., Zheng, H.Y., Hu, Q.J., Tang, C.M.: A new superlinearly convergent norm-relaxed method of strongly sub-feasible direction for inequality constrained optimization. Appl. Math. Comput. 182, 955–976 (2006)
Jian, J.B.: Fast Algorithms for Smooth Constrained Optimization-Theoretical Analysis and Numerical Experiments. Science Press, Beijing (2010)
Solodov, M.V.: Global convergence of an SQP method without boundedness assumptions on any of iterative sequences. Math. Program. 118, 1–12 (2009)
Zheng, H.Y., Jian, J.B., Tang, C.M., Quan, R.: A new norm-relaxed SQP algorithm with global convergence. Appl. Math. Lett. 23, 670–675 (2010)
Burke, J.V., More, J.J.: On the identification of active constraints. SIAM J. Numer. Anal. 25, 1197–1211 (1998)
Facchinei, F., Fischer, A., Kanzow, C.: On the accurate identification of active constraints. SIAM J. Optim. 9, 14–32 (1998)
Hare, W.L., Lewis, A.S.: Identifying active constraints via partial smoothness and prox-regularity. J. Convex Anal. 11, 251–266 (2004)
Jian, J.B., Liu, Y.: A superlinearly convergent method of quasi-strongly sub-feasible direction with active set identifying for constrained optimization. Nonlinear Anal., Real World Appl. 12, 2717–2729 (2011)
Chao, M.T., Wang, Z.X., Liang, Y.M., Hu, Q.J.: Quadratically constraint quadratical algorithm model for nonlinear minimax problems. Appl. Math. Comput. 205, 247–262 (2008)
Karmitsa, N.: Test problems for large-scale nonsmooth minimization. Reports of the Department of Mathematical Information Technology, Series B. Scientific Computing, No. B.4 (2007)
Acknowledgements
Project supported by NSFC (No. 11271086 and 11171250), the Natural Science Foundation of Guangxi Province (No. 2011GXNSFD018022), and Innovation Group of Talents Highland of Guangxi Higher School.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Jian, Jb., Hu, Qj. & Tang, Cm. Superlinearly Convergent Norm-Relaxed SQP Method Based on Active Set Identification and New Line Search for Constrained Minimax Problems. J Optim Theory Appl 163, 859–883 (2014). https://doi.org/10.1007/s10957-013-0503-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10957-013-0503-5