Hexa Scholar

Optimization

Convexity, Lagrange multipliers, duality and dynamic programming.

16 planned

No page in this subject is open yet. The planned list below shows what is coming, in learning order.

Planned

In learning order. These are not pages yet.

  1. Dynamic programming: solving backward from the endAdvanced undergrad
  2. Convex sets and convex functionsAdvanced undergrad
  3. Why convex problems have no bad local minimaAdvanced undergrad
  4. Separating hyperplanes: a line between two convex setsAdvanced undergrad
  5. Lagrange multipliers: why the gradients line upIntro
  6. Linear programming: why the optimum sits at a cornerAdvanced undergrad
  7. Critical points in two variables: bowl, peak, or saddleIntro
  8. Farkas' lemma: either a solution or a certificateGraduate
  9. What a Lagrange multiplier is worth: shadow pricesAdvanced undergrad
  10. Inequality constraints and the KKT conditionsAdvanced undergrad
  11. Gradient descent and the step sizeAdvanced undergrad
  12. Two-stage stochastic programming: deciding before uncertainty resolvesGraduate
  13. Duality: the lower bound that meets the optimumGraduate
  14. Fitting a model by nonlinear least squaresAdvanced undergrad
  15. Quadratic programming: minimizing a bowl over a polygonAdvanced undergrad
  16. The Hamilton-Jacobi-Bellman equation: dynamic programming in continuous timeGraduate