Systems of Differential Equations

Study Sheet

Systems of Differential Equations

Eigenvalues run the phase portrait

Linear Systems

Tip
Solve along eigenvectors

For u′=Au\mathbf u' = A\mathbf u, each eigenpair gives a straight-line solution eλtve^{\lambda t}\mathbf v, and the general solution mixes them. The eigenvalue signs shape the picture: both negative — everything decays to the origin (sink); both positive — source; opposite signs (det⁡A<0\det A < 0) — a saddle.

Why straight lines: if u(0)\mathbf u(0) lies on an eigenvector's line, then AuA\mathbf u points along that same line, so the motion never leaves it; it only stretches (λ>0\lambda > 0) or shrinks (λ<0\lambda < 0) at the rate eλte^{\lambda t}. Any other starting point is a combination of two eigenvectors, each component evolves on its own, and the trajectory is steered by whichever exponential dominates.

Concept
Complex eigenvalues spiral

Eigenvalues α±βi\alpha \pm \beta i make trajectories rotate with rate β\beta while eαte^{\alpha t} scales them: spirals in or out, or pure circles when α=0\alpha = 0. The system x′=yx' = y, y′=−xy' = -x is the cleanest case: x(t)=cos⁡tx(t) = \cos t from (1,0)(1,0) — a rotation, forever.

Why rotation: a complex eigenvalue α+βi\alpha + \beta i with eigenvector a+ib\mathbf a + i\mathbf b gives the complex solution eαt(cos⁡βt+isin⁡βt)(a+ib)e^{\alpha t}(\cos\beta t + i\sin\beta t)(\mathbf a + i\mathbf b). Its real and imaginary parts are real solutions built from cos⁡βt\cos\beta t and sin⁡βt\sin\beta t, which turn at angular rate β\beta while the factor eαte^{\alpha t} scales them, so the sign of α\alpha alone decides between spiraling in, spiraling out, and closed orbits.

Example
Decoupled warm-up
xy−2−11−2−11
x′=2xx' = 2x, y′=3yy' = 3y: a source; trajectories leave tangent to the xx-axis (the slower eigenvalue) and bend upward.

x′=2xx' = 2x, y′=3yy' = 3y solves coordinate-wise: (e2t,e3t)(e^{2t}, e^{3t}). Diagonalization is the art of choosing coordinates that make every system look like this one.

Eliminating tt from x=ae2tx = ae^{2t}, y=be3ty = be^{3t} gives y=b(xa)3/2y = b\left(\tfrac xa\right)^{3/2}. Near the origin (t→−∞t \to -\infty) the ratio yx=baet\tfrac yx = \tfrac ba e^{t} tends to 00, so every trajectory leaves the origin tangent to the xx-axis, the eigenvector of the smaller eigenvalue 22; farther out, the faster growth of yy bends it toward the vertical. The axes themselves are the two straight-line solutions.

Side note
Significance: coupled everything

Predator-prey cycles, coupled pendulums, chemical reaction networks, epidemic compartments (S-I-R), and multi-loop circuits are systems of ODEs. The eigenvalue portrait — sink, source, saddle, spiral — is the universal vocabulary for "what happens in the long run" across all of them.

Try it
Try it: classify at a glance

Classify the origin for u′=(−311−3)u\mathbf u' = \begin{pmatrix}-3&1\\1&-3\end{pmatrix}\mathbf u using the trace and determinant; then find the eigenvalues and the direction of fastest decay.

Show the answer

Trace −6<0-6 < 0, determinant 9−1=8>09 - 1 = 8 > 0, and discriminant tr2−4det⁡=36−32=4>0\mathrm{tr}^2 - 4\det = 36 - 32 = 4 > 0: two real negative eigenvalues, a stable node. They are the roots of λ2+6λ+8=(λ+2)(λ+4)\lambda^2 + 6\lambda + 8 = (\lambda + 2)(\lambda + 4): λ=−2\lambda = -2 with eigenvector (1,1)(1, 1) and λ=−4\lambda = -4 with eigenvector (1,−1)(1, -1). Every solution decays to the origin; the component along (1,−1)(1, -1) dies fastest, like e−4te^{-4t}, so trajectories arrive tangent to the slow line y=xy = x.

Complex Eigenvalues: Spirals and Centers

Tip
Real solutions from a complex eigenpair

If AA has eigenvalue λ=α+βi\lambda = \alpha + \beta i (β≠0\beta \ne 0) with eigenvector v=a+ib\mathbf v = \mathbf a + i\mathbf b, the real and imaginary parts of eλtve^{\lambda t}\mathbf v,

u1=eαt(acos⁡βt−bsin⁡βt),u2=eαt(asin⁡βt+bcos⁡βt),\mathbf u_1 = e^{\alpha t}(\mathbf a\cos\beta t - \mathbf b\sin\beta t), \qquad \mathbf u_2 = e^{\alpha t}(\mathbf a\sin\beta t + \mathbf b\cos\beta t),

are two independent real solutions, and u=c1u1+c2u2\mathbf u = c_1\mathbf u_1 + c_2\mathbf u_2. The origin is a stable spiral if α<0\alpha < 0, an unstable spiral if α>0\alpha > 0, and a center if α=0\alpha = 0.

Because AA is real, the equation w′=Aw\mathbf w' = A\mathbf w for a complex solution w\mathbf w splits into the same equation for its real part and for its imaginary part, so each part is a real solution. Expanding eαt(cos⁡βt+isin⁡βt)(a+ib)e^{\alpha t}(\cos\beta t + i\sin\beta t)(\mathbf a + i\mathbf b) and separating real from imaginary gives the two formulas. The conjugate eigenvalue adds nothing new — its solution is the complex conjugate — so one complex eigenpair supplies both real solutions.

Example
Worked: a spiral sink
xy(1, 0)
u=e−t(cos⁡4t,sin⁡4t)\mathbf u = e^{-t}(\cos 4t, \sin 4t) from (1,0)(1, 0): counterclockwise, shrinking by the factor e−π/2e^{-\pi/2} each turn.

Solve u′=(−1−44−1)u\mathbf u' = \begin{pmatrix}-1&-4\\4&-1\end{pmatrix}\mathbf u with u(0)=(1,0)\mathbf u(0) = (1, 0).

Step 1 — det⁡(A−λI)=(λ+1)2+16\det(A - \lambda I) = (\lambda + 1)^2 + 16, so λ=−1±4i\lambda = -1 \pm 4i; the real part is negative, so the origin is a stable spiral.

Step 2 — for λ=−1+4i\lambda = -1 + 4i, (A−λI)v=(−4i−44−4i)v=0(A - \lambda I)\mathbf v = \begin{pmatrix}-4i&-4\\4&-4i\end{pmatrix}\mathbf v = \mathbf 0 is solved by v=(1,−i)\mathbf v = (1, -i), so a=(1,0)\mathbf a = (1, 0) and b=(0,−1)\mathbf b = (0, -1).

Step 3 — the real solutions: u1=e−t(cos⁡4t,sin⁡4t)\mathbf u_1 = e^{-t}(\cos 4t, \sin 4t) and u2=e−t(sin⁡4t,−cos⁡4t)\mathbf u_2 = e^{-t}(\sin 4t, -\cos 4t).

Step 4 — the data: c1(1,0)+c2(0,−1)=(1,0)c_1(1, 0) + c_2(0, -1) = (1, 0), so c1=1c_1 = 1, c2=0c_2 = 0, and u=e−t(cos⁡4t,sin⁡4t)\mathbf u = e^{-t}(\cos 4t, \sin 4t).

Step 5 — read it: the point turns counterclockwise at angular rate 44 while its distance e−te^{-t} from the origin shrinks; each full turn takes time π2\tfrac\pi2 and multiplies the distance by e−π/2≈0.208e^{-\pi/2} \approx 0.208.

Step 6 — verify: x′=−e−tcos⁡4t−4e−tsin⁡4t=−x−4yx' = -e^{-t}\cos 4t - 4e^{-t}\sin 4t = -x - 4y ✓ and y′=−e−tsin⁡4t+4e−tcos⁡4t=4x−yy' = -e^{-t}\sin 4t + 4e^{-t}\cos 4t = 4x - y ✓.

Example
Worked: a tilted spiral

Solve u′=(1−15−3)u\mathbf u' = \begin{pmatrix}1&-1\\5&-3\end{pmatrix}\mathbf u with u(0)=(1,1)\mathbf u(0) = (1, 1).

Step 1 — trace −2-2 and determinant −3+5=2-3 + 5 = 2, so λ2+2λ+2=0\lambda^2 + 2\lambda + 2 = 0 and λ=−1±i\lambda = -1 \pm i: a stable spiral.

Step 2 — for λ=−1+i\lambda = -1 + i the first row of A−λIA - \lambda I is (2−i, −1)(2 - i,\ -1), so v=(1,2−i)\mathbf v = (1, 2 - i) works: a=(1,2)\mathbf a = (1, 2) and b=(0,−1)\mathbf b = (0, -1).

Step 3 — u1=e−t(cos⁡t, 2cos⁡t+sin⁡t)\mathbf u_1 = e^{-t}(\cos t,\ 2\cos t + \sin t) and u2=e−t(sin⁡t, 2sin⁡t−cos⁡t)\mathbf u_2 = e^{-t}(\sin t,\ 2\sin t - \cos t).

Step 4 — the data: c1(1,2)+c2(0,−1)=(1,1)c_1(1, 2) + c_2(0, -1) = (1, 1) gives c1=1c_1 = 1 and c2=1c_2 = 1.

Step 5 — so x=e−t(cos⁡t+sin⁡t)x = e^{-t}(\cos t + \sin t) and y=e−t(cos⁡t+3sin⁡t)y = e^{-t}(\cos t + 3\sin t).

Step 6 — verify: x′=−2e−tsin⁡tx' = -2e^{-t}\sin t and x−y=−2e−tsin⁡tx - y = -2e^{-t}\sin t ✓; y′=e−t(2cos⁡t−4sin⁡t)y' = e^{-t}(2\cos t - 4\sin t) and 5x−3y=e−t(2cos⁡t−4sin⁡t)5x - 3y = e^{-t}(2\cos t - 4\sin t) ✓. The loops are tilted and stretched because a\mathbf a and b\mathbf b are neither perpendicular nor of equal length.

Side note
Where it goes wrong: reading the rotation from β

Both (0−110)\begin{pmatrix}0&-1\\1&0\end{pmatrix} and (01−10)\begin{pmatrix}0&1\\-1&0\end{pmatrix} have eigenvalues ±i\pm i, so “β=+1\beta = +1 means counterclockwise” cannot be a rule: eigenvalues come in conjugate pairs and carry no orientation. Test one vector instead. At (1,0)(1, 0) the first matrix gives velocity (0,1)(0, 1), pointing up (counterclockwise); the second gives (0,−1)(0, -1), pointing down (clockwise). In general the velocity at (1,0)(1, 0) is the first column (a,c)(a, c) of AA, and with complex eigenvalues c≠0c \ne 0, so the sign of cc decides.

Try it
Try it: a center

Classify the origin for u′=(01−40)u\mathbf u' = \begin{pmatrix}0&1\\-4&0\end{pmatrix}\mathbf u, give the direction of rotation, and solve with u(0)=(1,0)\mathbf u(0) = (1, 0).

Show the answer

Trace 00, determinant 44: λ2+4=0\lambda^2 + 4 = 0, so λ=±2i\lambda = \pm 2i — a center. At (1,0)(1, 0) the velocity is (0,−4)(0, -4), pointing down, so the rotation is clockwise. The system says x′=yx' = y and y′=−4xy' = -4x, so x′′=−4xx'' = -4x with x(0)=1x(0) = 1 and x′(0)=y(0)=0x'(0) = y(0) = 0: x=cos⁡2tx = \cos 2t, and then y=x′=−2sin⁡2ty = x' = -2\sin 2t. The orbit is the ellipse 4x2+y2=44x^2 + y^2 = 4 (indeed 4cos⁡22t+4sin⁡22t=44\cos^2 2t + 4\sin^2 2t = 4), traversed clockwise with period π\pi.

Repeated Eigenvalues

Tip
When eigenvectors run short

If λ\lambda is a double eigenvalue but A−λIA - \lambda I has only one eigenvector line, spanned by v\mathbf v, the second solution is

u2=eλt(tv+w),(A−λI)w=v,\mathbf u_2 = e^{\lambda t}(t\mathbf v + \mathbf w), \qquad (A - \lambda I)\mathbf w = \mathbf v,

and u=c1eλtv+c2eλt(tv+w)\mathbf u = c_1e^{\lambda t}\mathbf v + c_2e^{\lambda t}(t\mathbf v + \mathbf w). The origin is a degenerate node: trajectories enter (or leave) tangent to the single eigenvector line. If instead A=λIA = \lambda I, every vector is an eigenvector and the trajectories are straight rays, a star node.

Differentiate the proposed solution: u2′=λeλt(tv+w)+eλtv\mathbf u_2' = \lambda e^{\lambda t}(t\mathbf v + \mathbf w) + e^{\lambda t}\mathbf v, while Au2=eλt(tλv+Aw)A\mathbf u_2 = e^{\lambda t}(t\lambda\mathbf v + A\mathbf w). They agree exactly when Aw=λw+vA\mathbf w = \lambda\mathbf w + \mathbf v, that is, (A−λI)w=v(A - \lambda I)\mathbf w = \mathbf v. This is the system version of the xerxxe^{rx} rule for a double root; the extra vector w\mathbf w is needed because teλtvte^{\lambda t}\mathbf v alone falls short by exactly eλtve^{\lambda t}\mathbf v, as the note below shows.

Example
Worked: a star node

Solve u′=(−200−2)u\mathbf u' = \begin{pmatrix}-2&0\\0&-2\end{pmatrix}\mathbf u with u(0)=(3,−1)\mathbf u(0) = (3, -1).

Step 1 — A=−2IA = -2I, so every nonzero vector is an eigenvector with λ=−2\lambda = -2.

Step 2 — each coordinate decays on its own: x=3e−2tx = 3e^{-2t} and y=−e−2ty = -e^{-2t}.

Step 3 — the ratio yx=−13\tfrac yx = -\tfrac13 never changes, so the trajectory is the straight ray from (3,−1)(3, -1) into the origin. Every trajectory is such a ray: a star node, stable because λ<0\lambda < 0. Here two independent eigenvectors exist, so no w\mathbf w is needed.

Example
Worked: a degenerate node
xy−11−11
A degenerate node: every trajectory enters the origin tangent to the one eigenvector line y=xy = x (dashed); the marked one starts at (1,0)(1, 0).

Solve u′=(−31−1−1)u\mathbf u' = \begin{pmatrix}-3&1\\-1&-1\end{pmatrix}\mathbf u with u(0)=(1,0)\mathbf u(0) = (1, 0).

Step 1 — trace −4-4 and determinant 3+1=43 + 1 = 4, so λ2+4λ+4=(λ+2)2\lambda^2 + 4\lambda + 4 = (\lambda + 2)^2: λ=−2\lambda = -2, double.

Step 2 — A+2I=(−11−11)A + 2I = \begin{pmatrix}-1&1\\-1&1\end{pmatrix} has rank 11, so there is a single eigenvector line, spanned by v=(1,1)\mathbf v = (1, 1).

Step 3 — solve (A+2I)w=v(A + 2I)\mathbf w = \mathbf v: both rows say −w1+w2=1-w_1 + w_2 = 1, so w=(0,1)\mathbf w = (0, 1) works.

Step 4 — u=c1e−2t(1,1)+c2e−2t(t(1,1)+(0,1))\mathbf u = c_1e^{-2t}(1, 1) + c_2e^{-2t}\left(t(1, 1) + (0, 1)\right), and at t=0t = 0, c1(1,1)+c2(0,1)=(1,0)c_1(1, 1) + c_2(0, 1) = (1, 0) gives c1=1c_1 = 1, c2=−1c_2 = -1.

Step 5 — u=e−2t(1−t, −t)\mathbf u = e^{-2t}(1 - t,\ -t).

Step 6 — verify: x′=(−3+2t)e−2tx' = (-3 + 2t)e^{-2t} and −3x+y=(−3+3t−t)e−2t-3x + y = (-3 + 3t - t)e^{-2t} ✓; y′=(−1+2t)e−2ty' = (-1 + 2t)e^{-2t} and −x−y=(−1+t+t)e−2t-x - y = (-1 + t + t)e^{-2t} ✓.

Step 7 — read it: for large tt the term −te−2t(1,1)-te^{-2t}(1, 1) dominates, so the trajectory crosses the yy-axis at t=1t = 1 and enters the origin along the line y=xy = x from the third quadrant.

Side note
Where it goes wrong: copying the scalar rule

For a double root of a scalar equation, tertte^{rt} is the second solution, so it is tempting to try u=teλtv\mathbf u = te^{\lambda t}\mathbf v. With A=(−31−1−1)A = \begin{pmatrix}-3&1\\-1&-1\end{pmatrix}, λ=−2\lambda = -2 and v=(1,1)\mathbf v = (1, 1): u′=e−2tv−2te−2tv\mathbf u' = e^{-2t}\mathbf v - 2te^{-2t}\mathbf v, while Au=te−2tAv=−2te−2tvA\mathbf u = te^{-2t}A\mathbf v = -2te^{-2t}\mathbf v. They differ by e−2t(1,1)e^{-2t}(1, 1), which is never zero. That missing piece is exactly what the extra term eλtwe^{\lambda t}\mathbf w supplies.

Try it
Try it: a repeated eigenvalue

Solve u′=(5−113)u\mathbf u' = \begin{pmatrix}5&-1\\1&3\end{pmatrix}\mathbf u with u(0)=(2,1)\mathbf u(0) = (2, 1).

Show the answer

Trace 88, determinant 15+1=1615 + 1 = 16: λ2−8λ+16=(λ−4)2\lambda^2 - 8\lambda + 16 = (\lambda - 4)^2, so λ=4\lambda = 4, double. A−4I=(1−11−1)A - 4I = \begin{pmatrix}1&-1\\1&-1\end{pmatrix} has rank 11, with eigenvector v=(1,1)\mathbf v = (1, 1). Solve (A−4I)w=v(A - 4I)\mathbf w = \mathbf v: w1−w2=1w_1 - w_2 = 1, so w=(1,0)\mathbf w = (1, 0). Data: c1(1,1)+c2(1,0)=(2,1)c_1(1, 1) + c_2(1, 0) = (2, 1) gives c1=1c_1 = 1, c2=1c_2 = 1. So u=e4t[(1,1)+t(1,1)+(1,0)]=e4t(2+t, 1+t)\mathbf u = e^{4t}\left[(1, 1) + t(1, 1) + (1, 0)\right] = e^{4t}(2 + t,\ 1 + t). Check: x′=(9+4t)e4tx' = (9 + 4t)e^{4t} and 5x−y=(10+5t−1−t)e4t5x - y = (10 + 5t - 1 - t)e^{4t} ✓; y′=(5+4t)e4ty' = (5 + 4t)e^{4t} and x+3y=(2+t+3+3t)e4tx + 3y = (2 + t + 3 + 3t)e^{4t} ✓. The origin is an unstable degenerate node.

Proofs & Why It Matters

Tip
Proof: e^λtv solves u′ = Au

Differentiate u(t)=eλtv\mathbf u(t) = e^{\lambda t}\mathbf v: u′=λeλtv\mathbf u' = \lambda e^{\lambda t}\mathbf v. Apply the matrix instead: Au=eλtAv=eλtλvA\mathbf u = e^{\lambda t}A\mathbf v = e^{\lambda t}\lambda\mathbf v using Av=λvA\mathbf v = \lambda\mathbf v.

The two agree, so every eigenpair yields a straight-line solution; independence of eigenvectors makes their combinations the general solution. ■\blacksquare

Tip
Proof: x′ = y, y′ = −x moves in circles

Let E(t)=x(t)2+y(t)2E(t) = x(t)^2 + y(t)^2. Then E′=2xx′+2yy′=2xy−2yx=0E' = 2xx' + 2yy' = 2xy - 2yx = 0: EE is constant, so trajectories stay on circles about the origin. Differentiating x′=yx' = y gives x′′=y′=−xx'' = y' = -x, simple harmonic motion, so from (1,0)(1,0): x=cos⁡tx = \cos t, y=−sin⁡ty = -\sin t — uniform rotation, confirming the circle. ■\blacksquare

Going Deeper: Explanations & Worked Problems

Concept
From eigenpairs to the phase portrait, step by step

To solve u′=Au\mathbf u' = A\mathbf u: find the eigenpairs of AA; each gives a straight-line solution eλtve^{\lambda t}\mathbf v; the general solution is c1eλ1tv1+c2eλ2tv2c_1e^{\lambda_1t}\mathbf v_1 + c_2e^{\lambda_2t}\mathbf v_2; initial data fixes c1,c2c_1, c_2 by writing u(0)\mathbf u(0) in the eigenbasis.

The picture follows from the signs alone: both λ<0\lambda < 0 — every trajectory slides to the origin (stable node); both >0> 0 — everything escapes (source); opposite signs — a saddle: trajectories sweep in along the negative eigenline and out along the positive one, and det⁡A=λ1λ2<0\det A = \lambda_1\lambda_2 < 0 detects this without computing anything else. Complex α±βi\alpha \pm \beta i: spirals, inward if α<0\alpha < 0, outward if α>0\alpha > 0, closed ellipses if α=0\alpha = 0. Trace and determinant of a 2×22\times2 thus classify the whole portrait before any solving happens.

Example
Worked: a full system solve with initial data
xy−22468−22468(3, 1)y = x
The trajectory through (3,1)(3, 1): it leaves the origin along (1,−1)(1, -1) (dashed) and bends toward the fast line y=xy = x.

Solve u′=(2112)u\mathbf u' = \begin{pmatrix}2&1\\1&2\end{pmatrix}\mathbf u, u(0)=(3,1)\mathbf u(0) = (3, 1).

Step 1 — eigenpairs (computed in the eigenvalue topic): λ=3\lambda = 3 with (1,1)(1,1); λ=1\lambda = 1 with (1,−1)(1,-1).

Step 2 — general solution: u=c1e3t(1,1)+c2et(1,−1)\mathbf u = c_1e^{3t}(1,1) + c_2e^{t}(1,-1).

Step 3 — initial data: (3,1)=c1(1,1)+c2(1,−1)(3, 1) = c_1(1,1) + c_2(1,-1) means c1+c2=3c_1 + c_2 = 3, c1−c2=1c_1 - c_2 = 1: c1=2c_1 = 2, c2=1c_2 = 1.

Step 4 — the answer: u(t)=2e3t(1,1)+et(1,−1)\mathbf u(t) = 2e^{3t}(1,1) + e^{t}(1,-1), i.e. x=2e3t+etx = 2e^{3t} + e^t, y=2e3t−ety = 2e^{3t} - e^t.

Step 5 — behavior: both eigenvalues are positive, so the origin is a source; as tt grows the e3te^{3t} term dominates and the trajectory hugs the line y=xy = x — the fast eigendirection — while for t→−∞t \to -\infty it aligned with (1,−1)(1,-1). Eigenvectors are the skeleton every trajectory drapes itself on.

Example
Worked: classify without solving
xy−2−11−2−11
The saddle of AA: trajectories come in along y=−xy = -x and leave along y=xy = x (the dashed eigenlines).

Classify the equilibrium of u′=Au\mathbf u' = A\mathbf u for A=(1221)A = \begin{pmatrix}1&2\\2&1\end{pmatrix}, then for B=(01−10)B = \begin{pmatrix}0&1\\-1&0\end{pmatrix}, using only trace and determinant.

For AA: det⁡=1−4=−3<0\det = 1 - 4 = -3 < 0 — eigenvalues have opposite signs (their product is negative): a saddle, unstable, no further computation required; indeed λ=3,−1\lambda = 3, -1 with eigenlines y=xy = x (outflow) and y=−xy = -x (inflow). For BB: tr=0\mathrm{tr} = 0, det⁡=1\det = 1: eigenvalues satisfy λ2+1=0\lambda^2 + 1 = 0, so λ=±i\lambda = \pm i — pure imaginary: closed orbits, a center; and indeed x′=y,y′=−xx' = y, y' = -x conserves x2+y2x^2 + y^2, so trajectories are literal circles. Two matrices, four numbers total examined, both portraits fully determined.