X-Git-Url: http://gitweb.michael.orlitzky.com/?p=octave.git;a=blobdiff_plain;f=optimization%2Fstep_length_positive_definite.m;h=5d3e8a0b2e92a1d4d4b54606ab9453b5a96be215;hp=7e15a46513e7333a63f060385f353720745dbc29;hb=1a6f56b0dd6750649725b2fd07edb3fe0850a886;hpb=2a9c5d796e2f9d7b2b50739f61ef382623d977d6 diff --git a/optimization/step_length_positive_definite.m b/optimization/step_length_positive_definite.m index 7e15a46..5d3e8a0 100644 --- a/optimization/step_length_positive_definite.m +++ b/optimization/step_length_positive_definite.m @@ -1,4 +1,4 @@ -function alpha = step_length_positive_definite(g, Q, p) +function alpha = step_length_positive_definite(g, Q) % % Find the minimizer alpha of, % @@ -11,34 +11,33 @@ function alpha = step_length_positive_definite(g, Q, p) % and ``Q`` is positive-definite. % % The closed-form solution to this problem is given in Nocedal and - % Wright, (3.55). + % Wright, (3.55). The direction of steepest descent will always be + % the negative gradient direction; this simplified form is given in + % Guler. % % INPUT: % % - ``g`` -- The gradient of f at x. % % - ``Q`` -- The positive-definite matrix in the definition of - % ``f`` above. - % - % - ``p`` -- The direction in which ``f`` decreases. The line - % along which we minimize f(x + alpha*p). + % ``f`` above. % % OUTPUT: % - % - ``alpha`` -- The value which causes ``f`` to decrease the - % most. + % - ``alpha`` -- The value which decreases ``f`` the most. % % NOTES: % % All vectors are assumed to be *column* vectors. % - denom = (p' * Q * p); + denom = (g' * Q * g); - if (abs(denom) < eps) + % denom is non-negative, since it's a Q-norm. No need to abs() it. + if (denom < eps) % Catch divide-by-zeros. If denom is effectively zero, set it to % something tiny instead. This trick is also used in the PCGM. - denom = sign(denom)*eps; + denom = eps; end - alpha = -(g' * p)/denom; + alpha = (g' * g)/denom; end