A variable-metric algorithm employing linear and quadratic penalties

Abstract

A variable-metric algorithm is described that uses both linear and quadratic penalty terms for handling nonlinear constraints. Quadratic penalty coefficients are adjusted in a process which maintains a positive-definite matrix of second partial derivatives of the function without generating the large positive eigenvalues which cause zigzagging and slow convergence. The schemes suggested use inferred second-order properties not only in terms of the variable metric of the Davidson-Fletcher-Powell algorithm (or its relatives) but by estimating of second directional derivatives by fitting cubics to various functions along search directions.