DFP and BFGS Algorithms

Both David-Fletcher-Powell (DFP) and Broyden-Fletcher-Goldfarb-Shanno (BFGS) algorithms belong to the group of the Pseudogradient (aka Quasi Newton)optimization algorithms. Pseudogradient methods are derived from gradient - based optimizations. These methods begin the search along a gradient line and use gradient information to build a quadratic fit to the model function. All of the algorithms involve a line search given by the following equation:

pseudogradient.jpg (2433 bytes)

In a DFP algorithm,

dfp_1.jpg (16267 bytes)

In a BFGS algorithm,

bfgs.jpg (11059 bytes)

Related Pages