Lagrange Multipliers Method

Definition

Lagrange multipliers find the extrema of a function $f$ subject to one or more constraints $g = 0$.

Why It Matters

Optimization in the real world always happens under constraints (budget, time, physics). Lagrange multipliers provide the “surgical” math needed to find the best possible outcome without violating the rules of the system.

Core Concepts

• Geometric Principle: At an extreme point, the level curve of $f$ must be tangent to the constraint curve $g$. This means their gradients are parallel: $\nabla f = \lambda \nabla g$

  • How to read: “The gradient of f equals lambda times the gradient of g.”
  • Meaning / when to use: At a constrained extremum, you cannot move along the constraint in a direction that changes $f$—gradients must point the same way (scaled by $\lambda$).

• The System: Solve $\nabla f = \lambda \nabla g$ along with the constraint equation $g = 0$.

• $\lambda$: The scalar multiplier represents the “shadow price” or the rate of change of the optimal value with respect to the constraint.

  • How to read: “The multiplier lambda.”
  • Meaning: How much the optimal objective value changes per unit relaxation of the constraint—marginal value of loosening the bound.

Connected Concepts

• The Closed Interval Method
• Euler’s Method
• Method of Variation of Parameters