15. Introduction to Calculus of Variations#

Calculus of variation deals with variations - i.e. “small changes” - of functions and functionals.

The meaning of the term functional may vary on the subfield of interest. In the field of calculus of variation, a functional can be defined as a function of function, i.e. a function whose argument is another function.

Fields and applications

Fields and applications related to calculus of variations (give some examples below):

  • gradient-based techniques like some methods in:

    • optimization, either free or constrained (via Lagrange multiplier methods)

    • sensitivity

  • classical mechanics and physics in general:

Examples
  • Lagrange equations for general problem

  • examples:

    • brachistochrone for minimum time,…

    • catenary, i.e. static solution of wire and cables with neglibile bending stiffness

    • isoperimetric inequality, i.e. circle is the plane closed curve with given perimeter enclosing the largest area

  • sensitivity of results to parameters. Some interesting sensitivity, both in time and trasnformed domains

    • characteristics of a system:

      • equilibria

      • eigenvalues

  • optimal control methods

15.1. Lagrange equations#

Given the functional S, with arguments a function q(t) and the independent variable t,

S[q(t),t]=t=t0t1L(q˙(t),q(t),t)dt

its variation w.r.t. the function q(t) reads

δS[q(t),t]=limε01ε(S[q(t)+εw(t),t]S[q(t),t])

where the function w(t) is arbitrary, among those satisfying the constraint of the problems: as an example here, if the function q(t) has prescribed values q for some values of the independent variable, t, the variation w(t) of the function q(t) is zero there, w(t) so that the variated function q(t)+εw(t) satisfies the constraint as well, i.e. q(t)+εw(t)=q.

Variation involves only small changes of function arguments, since these ones are the elements that can be effectively changed, while the independent variable is not.

Direct computation of the variation gives

δS[q(t),t]=limε01ε(S[q(t)+εw(t),t]S[q(t),t])==limε01ε(t=t0t1L(q˙(t)+εw(t),q(t)+εw(t),t)t=t0t1L(q˙(t),q(t),t)dt)==limε01εt=t0t1(L(q˙(t)+εw(t),q(t)+εw(t),t)L(q˙(t),q(t),t))dt==limε01εt=t0t1{L(q˙(t),q(t),t)+ε[Lq˙w˙(t)+Lqw(t)]+o(ε)L(q˙(t),q(t),t)}dt==limε01εt=t0t1{ε[Lq˙w˙(t)+Lqw(t)]+o(ε)}dt==t=t0t1{Lq˙w˙(t)+Lqw(t)}dt==[w(t)Lq˙]|t=t0t1+t=t0t1{ddt(Lq˙)+Lq}w(t)dt .

The solution depends on the boundary conditions at the extreme points t0, t1. If the value of the function q(t) is prescribed in t0 and t1, q(t0)=q0, q(t1)=q1, then its variation is zero, w(t0)=w(t1)=0, for the reason that has been discussed above. The variation of the functional with prescribed boundary values of the argument function thus reads

δS[q(t),t]=t=t0t1{ddt(Lq˙)+Lq}δq(t)dt ,

having called w(t)=:δq(t) to stress that is the variation of function q(t). This notation - it’s just notation, it has no special properties - could be useful if the functional depends on several arguments.

Stationary conditions, δS=0. Stationary condition of the functional S implies that δS=0 for all the possible variations of the argument function, δq(t). This condition implies that the integrand is identically zero, i.e. Lagrange equations,

ddt(Lq˙)Lq=0 ,
Higher-order derivatives

Method 1. If the Lagrangian function L depends on higher order derivatives,

L(q(n)(t),q(n1)(t),,q(t),q(t),t)

it’s possible to recast the problem defining the n-dimensional function, q(t),

q(t)=(q0(t),q1(t),,qn1(t)):=(q(t),q(t),,q(n1)(t)) .

With some abuse of notation in L, the functional S can be recasted as

S[q(t),t]=t=t0t1L(q(n)(t),,q(t),t)dt==t=t0t1L(q˙(t),q(t),t)dt .

todo Add constraints on components of q(t)?

Repeating the computation, the variation of the functional reads

δS[q(t),t]=[δqT(t)Lq˙]|t=t0t1+t=t0t1δqT(t){ddt(Lq˙)+Lq}dt .

Method 2.

15.1.1. Euler-Beltrami equation#

If the Lagrangian function L is not an explicit function of the independent variable, L(q(x),q(x)), Euler-Berltrami equation follows from the derivative of the Lagrangian,

dLdx=Lqq(x)+Lqq==Lqq+ddx(Lq)q==ddx(Lqq) ,

and thus

ddx[LqLq]=0LqLq=Cconst.

Note 1. While Lagrange equations are a set of N equations if the functional depends on N argument functions qk(t), k=1:N, Euler-Beltrami equation is an equation only. Indeed for multiple argument functions

dLdx=Lqkqk(x)+Lqkqk==Lqkqk+ddx(Lqk)qk=ddx(Lqkqk) ,

where Einstein’s summation notation of repeated index is used. Euler-Beltrami thus reads

L(ql(x),ql(x))qk(x)Lqk(ql(x),ql(x))=C .

Note 2. If the Lagrangian function is an explicit function of the independent variable x, L(q(x),q(x),x), it’s not hard to realize that the derivative of the Lagrangian function, along with the use of the Lagrange equation, gives

ddx[LqLq]=Lx .

Example 15.1 (Euler-Beltrami with L(q(x),q(x),x), Hamiltonian, energy and E.Noether)

Euler-Beltrami equation shows that if L(q(x),q(x)), thus LqqL is constant, (or an integral of motion in dynamics). In analytical mechanics (Lagrange mechanics, Hamiltonian mechanics), Lagrangian and Hamiltonian functions of a system read

L(q˙k(t),qk(t),t)=T(q˙,q,t)+U(q,t)H(p,q,t):=pkq˙kL=q˙kLq˙kL ,

having used the common definition of the generalized momenta pk:=Lq˙k. It should be immediate to realize that the Hamiltonian is just the quantity appearing in Euler-Beltrami equation (or in its “modified version” if tL0), and thus

dHdt=Lt .

In mechanics, if tL=0, the Hamiltonian is a constant of motion. In this case, it can be prove that the Hamiltonian is equal to the eneergy of the system.

Classical examples.

Example 15.2 (Brachistochrone)

Find the trajectory…

  • Elementary length: ds=vdt

  • Energy: E(y)=12mv2mgy+C. Setting E=0 at starting point, from rest, at y0=0, it implies C=0; thus v=2gy

  • x(s),y(s),

  • ds=dx2+dy2=1+y2(x)dx

T=t0t1dt=s0s1dsv=x0x11+y2(x)2gy(x)dx

The Lagrangian doesn’t explicitly depend on x, thus Euler-Beltrami equation can be used. Partial derivative of the Lagrangian function w.r.t. q reads

Ly=...=12gy1+y2y ,

and thus Euler-Beltrami equation reads

C=LqLy=1+y2y22gy1+y2=12gy1+y2

Squaring 2gC2=1y(1+y2), it’s possible to write

y(x)=12gC2(1+y2(x)) ,

Making the substitution y(x)=

Example 15.3 (Catenary)

Example 15.4 (Isoperimetric problem)