ANALYSIS OF A SELF-SCALING QUASI-NEWTON METHOD

Authors
Citation
J. Nocedal et Yx. Yuan, ANALYSIS OF A SELF-SCALING QUASI-NEWTON METHOD, Mathematical programming, 61(1), 1993, pp. 19-37
Citations number
19
Categorie Soggetti
Operatione Research & Management Science",Mathematics,"Operatione Research & Management Science",Mathematics,"Computer Applications & Cybernetics
Journal title
ISSN journal
00255610
Volume
61
Issue
1
Year of publication
1993
Pages
19 - 37
Database
ISI
SICI code
0025-5610(1993)61:1<19:AOASQM>2.0.ZU;2-R
Abstract
We study the self-scaling BFGS method of Oren and Luenberger (1974) fo r solving unconstrained optimization problems. For general convex func tions, we prove that the method is globally convergent with inexact li ne searches. We also show that the directions generated by the self-sc aling BFGS method approach Newton's direction asymptotically. This wou ld ensure superlinear convergence if, in addition, the search directio ns were well-scaled, but we show that this is not always the case. We find that the method has a major drawback: to achieve superlinear conv ergence it may be necessary to evaluate the function twice per iterati on, even very near the solution. An example is constructed to show tha t the step-sizes required to achieve a superlinear rate converge to 2 and 0.5 alternately.