From 729b8398bcd254e774b12765909f58e4e04aa9d1 Mon Sep 17 00:00:00 2001 From: Michael Orlitzky Date: Sun, 17 Mar 2013 22:21:04 -0400 Subject: [PATCH 1/1] Add step_size_positive_definite(). --- optimization/step_size_positive_definite.m | 29 ++++++++++++++++++++++ 1 file changed, 29 insertions(+) create mode 100644 optimization/step_size_positive_definite.m diff --git a/optimization/step_size_positive_definite.m b/optimization/step_size_positive_definite.m new file mode 100644 index 0000000..3e991a3 --- /dev/null +++ b/optimization/step_size_positive_definite.m @@ -0,0 +1,29 @@ +function alpha = step_size_positive_definite(Q, b, x) + % Let, + % + % f(x) = (1/2) - + a (1) + % + % where Q is symmetric and positive definite. + % + % If we seek to minimize f; that is, to solve Qx = b, then we can do + % so using the method of steepest-descent. This function computes + % the optimal step size alpha for the steepest descent method, in + % the negative-gradient direction, at x. + % + % INPUT: + % + % - ``Q`` -- the positive-definite matrix in the definition of f(x). + % + % - ``b`` -- the known vector in the definition of f(x). + % + % OUTPUT: + % + % - ``alpha`` -- the optimal step size in the negative gradient + % direction. + % + + % The gradient of f(x) is Qx - b, and d_k is the negative gradient + % direction. + d_k = b - Q*x; + alpha = (d_k' * d_k) / (d_k' * Q * d_k); +end -- 2.43.2