Nonlinear Systems & Linearization

Study Sheet

Nonlinear Systems & Linearization

Jacobians, predator–prey, competition, and the pendulum

Local Pictures of Nonlinear Worlds

Tip
Linearize at each equilibrium

A nonlinear system x′=f(x,y)x' = f(x,y), y′=g(x,y)y' = g(x,y) is understood equilibrium by equilibrium: find all points where f=g=0f = g = 0, compute the jacobian (fxfygxgy)\begin{pmatrix}f_x & f_y\\ g_x & g_y\end{pmatrix}, and evaluate it at each.

Near the equilibrium the system behaves like u′=Ju\mathbf u' = J\mathbf u, so the linear classification (saddle, node, spiral — by trace and determinant) applies locally. The Hartman–Grobman theorem makes this precise: when no eigenvalue of JJ has zero real part, the nonlinear picture near the equilibrium is a continuously deformed copy of the linear one. The exceptions are the borderline cases — purely imaginary eigenvalues (a linear center) or a zero eigenvalue — where the discarded nonlinear terms decide.

Tip
Predator–prey and competition, read from Jacobians
xy121
Competition: every orbit ends at (3,0)(3, 0) or (0,2)(0, 2); the dashed curve through the saddle (1,1)(1, 1) divides the winners.

Lotka–Volterra x′=x−xyx' = x - xy, y′=−y+xyy' = -y + xy: at the coexistence point (1,1)(1,1) the Jacobian is (0−110)\begin{pmatrix}0 & -1\\ 1 & 0\end{pmatrix} — trace 00, eigenvalues ±i\pm i: closed orbits, populations cycling forever out of phase.

Competing species x′=x(3−x−2y)x' = x(3 - x - 2y), y′=y(2−x−y)y' = y(2 - x - y): the interior equilibrium (1,1)(1,1) has Jacobian determinant −1<0-1 < 0 — a saddle, so coexistence is unstable and one species excludes the other. Ecology, decided by a determinant. The figure shows the competition model: the equilibria (3,0)(3, 0) and (0,2)(0, 2) are stable nodes, and the dashed curve into the saddle (1,1)(1, 1) — its stable manifold, leaving along the eigenvector (2,1)(\sqrt2, 1) of λ=−1−2\lambda = -1 - \sqrt2 — splits the quadrant into the two basins.

Example
Worked: the pendulum, honestly then linearized
xy−ππ
Pendulum phase plane: swings around (0,0)(0, 0), the dashed separatrix of energy 11 through the saddles at ±π\pm\pi, and spinning orbits outside.

The pendulum θ′′+sin⁡θ=0\theta'' + \sin\theta = 0 has equilibria at θ=0\theta = 0 (hanging) and θ=π\theta = \pi (balanced upright).

Step 1 — linearize at 00: sin⁡θ≈θ\sin\theta \approx \theta gives θ′′+θ=0\theta'' + \theta = 0, a center: small swings oscillate with period 2π2\pi.

Step 2 — linearize at π\pi: sin⁡θ≈−(θ−π)\sin\theta \approx -(\theta - \pi) gives u′′−u=0u'' - u = 0, eigenvalues ±1\pm1: a saddle — the inverted pendulum falls.

Step 3 — what linearization misses: the true period grows with amplitude, and the special orbits into the saddle separate swinging from over-the-top spinning. The phase portrait stitches all of this together.

Step 4 — the whole picture comes from the energy E=12y2−cos⁡θE = \tfrac12y^2 - \cos\theta (with y=θ′y = \theta'), which is constant along motion: closed loops around (0,0)(0, 0) are swings, the dashed curves y=±2cos⁡θ2y = \pm2\cos\tfrac\theta2 (energy 11) run into the saddles at ±π\pm\pi, and the wavy curves outside them are the pendulum spinning over the top.

Side note
Significance: where chaos begins

Linearization explains the local picture, but genuinely nonlinear systems can do what linear ones never can: multiple equilibria, limit cycles (heartbeats are one), and chaos (weather). The Jacobian toolkit of this topic is the entry door; the Lorenz attractor is what lives three doors down.

Try it
Try it: equilibria of a damped pendulum

For the damped pendulum x′=yx' = y, y′=−sin⁡x−yy' = -\sin x - y, find all the equilibria and classify the one at the origin.

Show the answer

Equilibria need y=0y = 0 and then sin⁡x=0\sin x = 0: the points (kπ,0)(k\pi, 0) for every integer kk. The Jacobian is (01−cos⁡x−1)\begin{pmatrix}0&1\\-\cos x&-1\end{pmatrix}. At the origin it is (01−1−1)\begin{pmatrix}0&1\\-1&-1\end{pmatrix}: trace −1-1, determinant 11, discriminant 1−4=−3<01 - 4 = -3 < 0, so the eigenvalues are −1±i32\tfrac{-1 \pm i\sqrt3}{2} — a stable spiral: the pendulum swings with shrinking amplitude. The real parts are nonzero, so the linearization's verdict is reliable. (At (π,0)(\pi, 0) the determinant is −1-1: a saddle, the balanced pendulum.)

Equilibria, Jacobians and Nullclines

Tip
A checklist for a planar system

For x′=f(x,y)x' = f(x, y), y′=g(x,y)y' = g(x, y):

  • Draw the nullclines f=0f = 0 (where motion is vertical) and g=0g = 0 (where it is horizontal).
  • The equilibria are their intersections. Factor ff and gg completely and take every combination of factors.
  • At each equilibrium evaluate the Jacobian and classify it by trace τ\tau and determinant Δ\Delta: Δ<0\Delta < 0 saddle; Δ>0\Delta > 0 with τ2>4Δ\tau^2 > 4\Delta node, with τ2<4Δ\tau^2 < 4\Delta spiral; stable if τ<0\tau < 0, unstable if τ>0\tau > 0.
  • If τ=0<Δ\tau = 0 < \Delta or Δ=0\Delta = 0, the linearization is inconclusive; look for a conserved quantity.

The nullclines cut the plane into regions where the signs of x′x' and y′y' are fixed, so they give the rough direction of motion everywhere before any computation. The trace–determinant rules come from the eigenvalues λ=τ±τ2−4Δ2\lambda = \tfrac{\tau \pm\sqrt{\tau^2 - 4\Delta}}{2}: Δ=λ1λ2<0\Delta = \lambda_1\lambda_2 < 0 forces real eigenvalues of opposite signs; when Δ>0\Delta > 0 the sign of τ2−4Δ\tau^2 - 4\Delta decides real versus complex, and τ=λ1+λ2\tau = \lambda_1 + \lambda_2 gives the sign of the real parts.

Example
Worked: a double well
xy−11−1
The double well: loops around the centers (±1,0)(\pm1, 0), the dashed figure eight E=0E = 0 through the saddle, and an orbit circling both wells.

Classify the equilibria of x′=yx' = y, y′=x−x3y' = x - x^3.

Step 1 — x′=0x' = 0 forces y=0y = 0; then x−x3=x(1−x)(1+x)=0x - x^3 = x(1 - x)(1 + x) = 0 gives x=0,±1x = 0, \pm1: the equilibria are (0,0)(0, 0), (1,0)(1, 0) and (−1,0)(-1, 0).

Step 2 — the Jacobian is (011−3x20)\begin{pmatrix}0&1\\1 - 3x^2&0\end{pmatrix}.

Step 3 — at (0,0)(0, 0) it is (0110)\begin{pmatrix}0&1\\1&0\end{pmatrix} with determinant −1-1: a saddle. At (±1,0)(\pm1, 0) it is (01−20)\begin{pmatrix}0&1\\-2&0\end{pmatrix}, trace 00, determinant 22, eigenvalues ±i2\pm i\sqrt2: a linear center, inconclusive on its own.

Step 4 — settle it with a conserved quantity: E=12y2−12x2+14x4E = \tfrac12y^2 - \tfrac12x^2 + \tfrac14x^4 has dEdt=y y′+(x3−x) x′=y(x−x3)+(x3−x)y=0\tfrac{dE}{dt} = y\,y' + (x^3 - x)\,x' = y(x - x^3) + (x^3 - x)y = 0, and (±1,0)(\pm1, 0) are strict minima of EE (value −14-\tfrac14), so the nearby level curves are closed loops: true centers.

Step 5 — the level curve E=0E = 0 through the saddle is a figure eight, separating orbits that circle one well from orbits that circle both.

Example
Worked: a spiral and a saddle

Find and classify the equilibria of x′=x−yx' = x - y, y′=x2−4y' = x^2 - 4.

Step 1 — y′=0y' = 0 gives x=±2x = \pm2, and x′=0x' = 0 gives y=xy = x: the equilibria are (2,2)(2, 2) and (−2,−2)(-2, -2).

Step 2 — the Jacobian is (1−12x0)\begin{pmatrix}1&-1\\2x&0\end{pmatrix}.

Step 3 — at (2,2)(2, 2): (1−140)\begin{pmatrix}1&-1\\4&0\end{pmatrix}, trace 11, determinant 44, and τ2−4Δ=1−16<0\tau^2 - 4\Delta = 1 - 16 < 0: an unstable spiral. At (−2,−2)(-2, -2): (1−1−40)\begin{pmatrix}1&-1\\-4&0\end{pmatrix}, determinant −4<0-4 < 0: a saddle.

Step 4 — both verdicts are reliable, because neither Jacobian has an eigenvalue with zero real part.

Side note
Where it goes wrong: dividing away an equilibrium

In the double well, solving x−x3=0x - x^3 = 0 by dividing by xx leaves 1−x2=01 - x^2 = 0, so x=±1x = \pm1 — and the saddle at the origin, the point that organizes the whole picture, is lost. The same slip in a competition model, dividing x(3−x−2y)=0x(3 - x - 2y) = 0 by xx, loses the entire axis x=0x = 0 and the equilibria on it. Factor instead of dividing, and use every factor.

Try it
Try it: two equilibria

Find and classify the equilibria of x′=y−x2x' = y - x^2, y′=y−2xy' = y - 2x.

Show the answer

Equilibria: y=x2y = x^2 and y=2xy = 2x, so x2=2xx^2 = 2x, i.e. x(x−2)=0x(x - 2) = 0: the points (0,0)(0, 0) and (2,4)(2, 4). The Jacobian is (−2x1−21)\begin{pmatrix}-2x&1\\-2&1\end{pmatrix}. At (0,0)(0, 0): (01−21)\begin{pmatrix}0&1\\-2&1\end{pmatrix}, trace 11, determinant 22, τ2−4Δ=1−8<0\tau^2 - 4\Delta = 1 - 8 < 0: an unstable spiral. At (2,4)(2, 4): (−41−21)\begin{pmatrix}-4&1\\-2&1\end{pmatrix}, determinant −4+2=−2<0-4 + 2 = -2 < 0: a saddle.

Conserved Quantities and Closed Orbits

Tip
When a quantity is conserved

If E(x,y)E(x, y) satisfies Exf+Eyg=0E_x f + E_y g = 0 for the system x′=fx' = f, y′=gy' = g, every trajectory stays on a level curve E=CE = C. Near a strict local minimum or maximum of EE the level curves are small closed loops, so an equilibrium there is a true center. For x′′+V′(x)=0x'' + V'(x) = 0, written as x′=yx' = y, y′=−V′(x)y' = -V'(x), the energy E=12y2+V(x)E = \tfrac12y^2 + V(x) is conserved.

The chain rule gives ddtE(x(t),y(t))=Exx′+Eyy′\tfrac{d}{dt}E(x(t), y(t)) = E_x x' + E_y y', so the condition says exactly that EE does not change along motion. For the energy, Exf+Eyg=V′(x) y+y (−V′(x))=0E_x f + E_y g = V'(x)\,y + y\,(-V'(x)) = 0: kinetic energy 12y2\tfrac12y^2 and potential energy VV trade off. A conserved quantity turns a two-dimensional problem into drawing level curves, which is how the borderline linear-center cases are settled.

Example
Worked: predator–prey cycles
xy246824
Cycles of x′=x(2−y)x' = x(2 - y), y′=y(x−3)y' = y(x - 3) around (3,2)(3, 2), each a level curve of EE, traversed counterclockwise.

For x′=x(2−y)x' = x(2 - y), y′=y(x−3)y' = y(x - 3) with x,y>0x, y > 0, find the coexistence equilibrium and show that the orbits around it close.

Step 1 — the equilibrium needs y=2y = 2 and x=3x = 3: the point (3,2)(3, 2). The Jacobian there is (2−y−xyx−3)=(0−320)\begin{pmatrix}2 - y&-x\\y&x - 3\end{pmatrix} = \begin{pmatrix}0&-3\\2&0\end{pmatrix}, with eigenvalues ±i6\pm i\sqrt6: a linear center, inconclusive.

Step 2 — try E=x−3ln⁡x+y−2ln⁡yE = x - 3\ln x + y - 2\ln y.

Step 3 — dEdt=(1−3x)x(2−y)+(1−2y)y(x−3)=(x−3)(2−y)+(y−2)(x−3)=0\dfrac{dE}{dt} = \left(1 - \dfrac3x\right)x(2 - y) + \left(1 - \dfrac2y\right)y(x - 3) = (x - 3)(2 - y) + (y - 2)(x - 3) = 0.

Step 4 — EE has a strict minimum at (3,2)(3, 2), since each piece s−aln⁡ss - a\ln s is smallest at s=as = a; so the level curves around (3,2)(3, 2) are closed and every orbit is a cycle, with the prey peaking before the predators.

Step 5 — the linearization's frequency 6\sqrt6 gives small cycles a period of about 2π6≈2.57\tfrac{2\pi}{\sqrt6} \approx 2.57; larger cycles take longer.

Example
Worked: how fast to spin a pendulum over the top

The pendulum x′′+sin⁡x=0x'' + \sin x = 0 has energy E=12y2−cos⁡xE = \tfrac12y^2 - \cos x, with y=x′y = x'. Started at the bottom (x=0x = 0) with speed y0y_0, when does it go over the top?

Step 1 — E=12y02−1E = \tfrac12y_0^2 - 1 is conserved.

Step 2 — at the top, x=πx = \pi, the energy is 12y2+1≥1\tfrac12y^2 + 1 \ge 1, so reaching the top requires E≥1E \ge 1.

Step 3 — so it passes over the top when 12y02−1>1\tfrac12y_0^2 - 1 > 1, that is, y0>2y_0 > 2.

Step 4 — the borderline y0=2y_0 = 2 gives E=1E = 1, the separatrix y=±2cos⁡x2y = \pm2\cos\tfrac x2 (dashed in the pendulum figure): the pendulum creeps toward the upright position and never quite reaches it.

Step 5 — for y0<2y_0 < 2 it swings between turning points where y=0y = 0, i.e. cos⁡x=1−12y02\cos x = 1 - \tfrac12y_0^2; for example y0=1y_0 = 1 turns at cos⁡x=12\cos x = \tfrac12, x=±π3x = \pm\tfrac\pi3.

Side note
Where it goes wrong: trusting a guessed invariant

For x′=yx' = y, y′=−x−x3y' = -x - x^3, the guess E=x2+y2E = x^2 + y^2 gives dEdt=2xy+2y(−x−x3)=−2x3y\tfrac{dE}{dt} = 2xy + 2y(-x - x^3) = -2x^3y, not zero, so its circles are not orbits. The energy recipe with V′(x)=x+x3V'(x) = x + x^3 gives V=12x2+14x4V = \tfrac12x^2 + \tfrac14x^4 and E=12y2+12x2+14x4E = \tfrac12y^2 + \tfrac12x^2 + \tfrac14x^4, for which dEdt=(x+x3)y+y(−x−x3)=0\tfrac{dE}{dt} = (x + x^3)y + y(-x - x^3) = 0. Differentiate a proposed invariant along the flow before trusting it.

Try it
Try it: energy and a saddle

For x′′+x−x2=0x'' + x - x^2 = 0, write the system, find its energy, locate and classify the equilibria, and find the energy of the orbit through the saddle.

Show the answer

With y=x′y = x': x′=yx' = y and y′=x2−xy' = x^2 - x. Here V′(x)=x−x2V'(x) = x - x^2, so V=12x2−13x3V = \tfrac12x^2 - \tfrac13x^3 and E=12y2+12x2−13x3E = \tfrac12y^2 + \tfrac12x^2 - \tfrac13x^3. Equilibria: y=0y = 0 and x(x−1)=0x(x - 1) = 0, so (0,0)(0, 0) and (1,0)(1, 0). The Jacobian (012x−10)\begin{pmatrix}0&1\\2x - 1&0\end{pmatrix} has trace 00 and determinant 11 at the origin — a linear center, and a true center because (0,0)(0, 0) is a strict minimum of EE — and determinant −1-1 at (1,0)(1, 0): a saddle. The orbit through the saddle has E=0+12−13=16E = 0 + \tfrac12 - \tfrac13 = \tfrac16; the orbits inside its loop around the origin have E<16E < \tfrac16 and are closed.

Proofs & Why It Matters

Tip
Proof: why the Jacobian is the right linearization

Write x=x∗+u\mathbf x = \mathbf x^* + \mathbf u for a small displacement from the equilibrium x∗\mathbf x^*. Taylor: f(x∗+u)=f(x∗)+fxu1+fyu2+O(∣u∣2)f(\mathbf x^* + \mathbf u) = f(\mathbf x^*) + f_x u_1 + f_y u_2 + O(|\mathbf u|^2), and f(x∗)=0f(\mathbf x^*) = 0 by definition of equilibrium.

So u′=Ju+O(∣u∣2)\mathbf u' = J\mathbf u + O(|\mathbf u|^2): to first order the displacement obeys the linear system with matrix JJ, and when JJ's eigenvalues have nonzero real part the quadratic remainder is too weak to change the picture. ■\blacksquare

Tip
Proof: Lotka–Volterra orbits really close up

The quantity E(x,y)=x−ln⁡x+y−ln⁡yE(x, y) = x - \ln x + y - \ln y is conserved along solutions of x′=x−xyx' = x - xy, y′=−y+xyy' = -y + xy. By the chain rule, dEdt=(1−1x)x′+(1−1y)y′\tfrac{dE}{dt} = \left(1 - \tfrac1x\right)x' + \left(1 - \tfrac1y\right)y', and the two products simplify: (1−1x)(x−xy)=(x−1)(1−y)\left(1 - \tfrac1x\right)(x - xy) = (x - 1)(1 - y) and (1−1y)(−y+xy)=(y−1)(x−1)\left(1 - \tfrac1y\right)(-y + xy) = (y - 1)(x - 1). Their sum is (x−1)[(1−y)+(y−1)]=0(x - 1)\left[(1 - y) + (y - 1)\right] = 0.

Reminder — The differentiation rules:  (xn)′=nxn−1,(fg)′=f′g+fg′,(fg)′=f′g−fg′g2,(f(g(x)))′=f′(g(x))g′(x)(x^{n})'=nx^{n-1},\quad (fg)'=f'g+fg',\quad \left(\tfrac{f}{g}\right)'=\frac{f'g-fg'}{g^{2}},\quad \big(f(g(x))\big)'=f'(g(x))g'(x)

Trajectories live on level curves of EE, which are closed loops around (1,1)(1,1) — so the center predicted by the linearization is genuine, not an artifact. ■\blacksquare

Going Deeper: Worked Problems

Example
Worked: a full phase-portrait classification

Classify every equilibrium of x′=x(2−x−y)x' = x(2 - x - y), y′=y(3−2x−y)y' = y(3 - 2x - y).

Step 1 — equilibria: each equation vanishes on two curves; intersections: (0,0)(0,0), (2,0)(2,0), (0,3)(0,3), and the interior solution of x+y=2x + y = 2, 2x+y=32x + y = 3: (1,1)(1, 1).

Step 2 — Jacobian: (2−2x−y−x−2y3−2x−2y)\begin{pmatrix}2 - 2x - y & -x\\ -2y & 3 - 2x - 2y\end{pmatrix}.

Step 3 — evaluate and classify: at (0,0)(0,0): diag(2,3)\mathrm{diag}(2,3), both positive — source. At (2,0)(2,0): (−2−20−1)\begin{pmatrix}-2&-2\\0&-1\end{pmatrix}, eigenvalues −2,−1-2,-1 — stable node. At (0,3)(0,3): (−10−6−3)\begin{pmatrix}-1&0\\-6&-3\end{pmatrix}, eigenvalues −1,−3-1,-3 — stable node. At (1,1)(1,1): (−1−1−2−1)\begin{pmatrix}-1&-1\\-2&-1\end{pmatrix}, det =1−2=−1<0= 1 - 2 = -1 < 0 — saddle.

Step 4 — the story: two stable "one species wins" states, an unstable coexistence saddle whose stable manifold is the knife-edge dividing the winners. Competitive exclusion, read off four small matrices.

Example
Worked: linearization that lies, and what settles it
xy−11−11
The orbit from (0.2,0)(0.2, 0): the linearization predicts a circle, but the cubic terms push it outward (r′=r3r' = r^3).

The system x′=−y+x(x2+y2)x' = -y + x(x^2 + y^2), y′=x+y(x2+y2)y' = x + y(x^2 + y^2) has Jacobian (0−110)\begin{pmatrix}0&-1\\1&0\end{pmatrix} at the origin — a center. Is the origin actually stable?

Step 1 — the linearization says "center" (eigenvalues ±i\pm i), the one case Hartman–Grobman does not cover.

Step 2 — switch to polar coordinates: with r2=x2+y2r^2 = x^2 + y^2, compute rr′=xx′+yy′=x(−y+xr2)+y(x+yr2)=r4rr' = xx' + yy' = x(-y + xr^2) + y(x + yr^2) = r^4, so r′=r3>0r' = r^3 > 0.

Step 3 — the radius grows: trajectories spiral outward, and the origin is unstable — the cubic terms the linearization discarded decide everything.

Step 4 — the lesson: when the linear part gives a center, look for a conserved quantity (as with Lotka–Volterra) or a radial equation; only nonlinear information can break the tie. Solving r′=r3r' = r^3 exactly: r(t)=(r0−2−2t)−1/2r(t) = \left(r_0^{-2} - 2t\right)^{-1/2}, which reaches infinity at t=12r02t = \tfrac{1}{2r_0^2}, while the angle turns at rate 11.