Abstract
This chapter briefly introduces the most widely used traditional optimization algorithms, including the gradient based method and its variants, basic methods for constrained optimization, pattern search for non-differentiable or black-box optimization problems, and deterministic global optimization methods.