Differential Equations on the Putnam

Study Sheet

Differential Equations on the Putnam

Separable and linear equations, uniqueness by integrating factor, blow-up, and Grönwall

The ODE Toolkit the Exam Assumes

Tip
Separable and first-order linear equations

Separable: y′=f(x)g(y)⇒∫dyg(y)=∫f(x)dxy' = f(x)g(y) \Rightarrow \int\tfrac{dy}{g(y)} = \int f(x)dx. Linear: y′+P(x)y=Q(x)y' + P(x)y = Q(x) is solved by the integrating factor μ=e∫P\mu = e^{\int P}, which makes (μy)′=μQ(\mu y)' = \mu Q.

The Putnam never asks you to solve a hard ODE; it asks you to recognize that a functional condition IS an ODE, solve the easy ODE, and then argue about existence, uniqueness, or a bound. y′=y2y' = y^2 with y(0)=1y(0) = 1 gives y=11−xy = \tfrac{1}{1-x} — and the point of the problem is the blow-up at x=1x = 1: no solution exists on all of R\mathbb R. Likewise f′=1+f2f' = 1 + f^2 forces f=tan⁡f = \tan, which cannot be defined on an interval longer than π\pi.

Tip
Uniqueness by integrating factor, and Grönwall

If f′=ff' = f then (fe−x)′=0(fe^{-x})' = 0, so f=Cexf = Ce^x. If f′≤ff' \le f and f(0)=1f(0) = 1, then fe−xfe^{-x} is non-increasing, so f(x)≤exf(x) \le e^x for x≥0x \ge 0 (Grönwall).

Multiplying by e−xe^{-x} converts a differential equation into "a derivative is zero" and a differential INEQUALITY into "a function is monotone" — the two-line arguments graders want in place of "obviously the solution is exe^x". For second-order equations the analogous tool is an energy: for y′′+y=0y'' + y = 0, E=y2+y′2E = y^2 + y'^2 has E′=2y′(y+y′′)=0E' = 2y'(y + y'') = 0, so a solution with y(0)=y′(0)=0y(0) = y'(0) = 0 has E≡0E \equiv 0 and is identically zero — uniqueness for free.

Tip
Constant-coefficient linear equations

y′′+py′+qy=0y'' + py' + qy = 0 has solutions erxe^{rx} for the roots rr of r2+pr+q=0r^2 + pr + q = 0 (with xerxxe^{rx} for a double root, and eaxcos⁡bxe^{ax}\cos bx, eaxsin⁡bxe^{ax}\sin bx for r=a±bir = a \pm bi).

The solution space is two-dimensional (a solution is determined by y(0),y′(0)y(0), y'(0) — that is the uniqueness theorem), so two independent solutions span everything. The same characteristic-root method solves linear recurrences, which is why the "Sequences" and "Differential Equations" units share a proof.

Side note
What the Putnam does with ODEs

Typical asks: show a function satisfying an f′(x)=f(x+1)f'(x) = f(x + 1)-type condition has a specific form; bound f(2)f(2) given f′≤ff' \le f; show a solution of y′=y2+xy' = y^2 + x cannot exist on all of R\mathbb R (compare with y′≥y2y' \ge y^2 after some point and use blow-up); compute ∫01f\int_0^1 f for the unique ff with f′=ff' = f, f(0)=1f(0) = 1. Existence and uniqueness (Picard) may be cited; blow-up must be argued.

Try it
Try it: an integrating factor

Solve y′+1xy=xy' + \tfrac{1}{x}y = x with y(1)=1y(1) = 1 and evaluate y(2)y(2).

Show the answer

μ=x\mu = x: (xy)′=x2(xy)' = x^2, so xy=x33+Cxy = \tfrac{x^3}{3} + C, C=23C = \tfrac23, and y(2)=12(83+23)=53y(2) = \tfrac12\left(\tfrac83 + \tfrac23\right) = \tfrac53.

Equations That Hide an ODE

Tip
Differentiate the condition, then read off initial values

A condition involving ∫0x\int_0^x or a shifted argument such as f(1−x)f(1 - x) often becomes an ordinary differential equation after one or two differentiations. The original condition, evaluated at a convenient point, supplies the initial values; at the end, check the answer in the ORIGINAL condition.

If ff is continuous, ∫0xg(t)f(t) dt\int_0^x g(t)f(t)\,dt is differentiable by the fundamental theorem of calculus, so an equation "f=f = something +∫0x…+ \int_0^x\ldots" forces ff itself to be differentiable — the equation bootstraps its own smoothness. Differentiating turns the integral into an ODE, which the uniqueness theorem then pins down once the initial values are known; those come from setting x=0x = 0 in the original, where every ∫00\int_0^0 vanishes. Differentiation can lose information (constants disappear), so the final check against the original condition is part of the proof.

Example
Worked: an integral equation (folklore)

Find all continuous ff with f(x)=1+∫0xt f(t) dtf(x) = 1 + \displaystyle\int_0^x t\,f(t)\,dt for all real xx.

Step 1 — the right side is differentiable (FTC), so ff is, and f′(x)=xf(x)f'(x) = xf(x). Setting x=0x = 0 in the original gives f(0)=1f(0) = 1.

Step 2 — integrating factor: (f(x)e−x2/2)′=(f′−xf)e−x2/2=0\left(f(x)e^{-x^2/2}\right)' = (f' - xf)e^{-x^2/2} = 0, so f(x)e−x2/2f(x)e^{-x^2/2} is constant, equal to its value 11 at x=0x = 0.

Step 3 — f(x)=ex2/2f(x) = e^{x^2/2}. Check: 1+∫0xtet2/2 dt=1+(ex2/2−1)=ex2/21 + \int_0^x te^{t^2/2}\,dt = 1 + \left(e^{x^2/2} - 1\right) = e^{x^2/2} ✓.

How to find it. An unknown function inside ∫0x\int_0^x is an antiderivative in disguise; one differentiation removes it.

Example
Worked: a convolution equation (folklore)

Find all continuous ff with f(x)=x+∫0x(x−t)f(t) dtf(x) = x + \displaystyle\int_0^x (x - t)f(t)\,dt for all real xx.

Step 1 — expand the integral as x∫0xf(t) dt−∫0xtf(t) dtx\int_0^xf(t)\,dt - \int_0^x tf(t)\,dt; both pieces are differentiable, and by the product rule and FTC f′(x)=1+∫0xf(t) dt+xf(x)−xf(x)=1+∫0xf(t) dtf'(x) = 1 + \int_0^x f(t)\,dt + xf(x) - xf(x) = 1 + \int_0^x f(t)\,dt.

Step 2 — differentiate again: f′′(x)=f(x)f''(x) = f(x).

Step 3 — initial values from the two equations at x=0x = 0: f(0)=0f(0) = 0 and f′(0)=1f'(0) = 1.

Step 4 — the solutions of f′′=ff'' = f are aex+be−xae^x + be^{-x}; the initial values give a+b=0a + b = 0, a−b=1a - b = 1, so f(x)=ex−e−x2=sinh⁡xf(x) = \tfrac{e^x - e^{-x}}{2} = \sinh x. Check: ∫0x(x−t)sinh⁡t dt=sinh⁡x−x\int_0^x(x - t)\sinh t\,dt = \sinh x - x (integrate by parts), so the right side is x+sinh⁡x−x=sinh⁡xx + \sinh x - x = \sinh x ✓.

How to find it. The kernel x−tx - t is what one integration by parts produces: ∫0x(x−t)f(t) dt\int_0^x(x - t)f(t)\,dt is the second antiderivative of ff. Two differentiations undo two integrations.

Example
Worked: a derivative equal to a reflection (folklore)
xy−2−1123−11x = 1/2ff ′
f(x) = sin x + cos(x − 1) and its derivative (dashed): the graph of f′ is the graph of f reflected in the line x = 1/2.

Find all differentiable f:R→Rf:\mathbb R\to\mathbb R with f′(x)=f(1−x)f'(x) = f(1 - x) for every xx.

Step 1 — the right side f(1−x)f(1 - x) is differentiable, so f′f' is, and f′′(x)=ddxf(1−x)=−f′(1−x)=−f(x)f''(x) = \tfrac{d}{dx}f(1 - x) = -f'(1 - x) = -f(x), applying the equation at the point 1−x1 - x.

Step 2 — so f′′+f=0f'' + f = 0, whose solutions are exactly f=Acos⁡x+Bsin⁡xf = A\cos x + B\sin x (uniqueness by the energy argument above).

Step 3 — the second-order equation has two constants; the first-order condition must remove one. Substitute: f′(x)=−Asin⁡x+Bcos⁡xf'(x) = -A\sin x + B\cos x, while f(1−x)=(Acos⁡1+Bsin⁡1)cos⁡x+(Asin⁡1−Bcos⁡1)sin⁡xf(1 - x) = (A\cos1 + B\sin1)\cos x + (A\sin1 - B\cos1)\sin x. Matching coefficients: B=Acos⁡1+Bsin⁡1B = A\cos1 + B\sin1 and −A=Asin⁡1−Bcos⁡1-A = A\sin1 - B\cos1, i.e. B(1−sin⁡1)=Acos⁡1B(1 - \sin1) = A\cos1 and Bcos⁡1=A(1+sin⁡1)B\cos1 = A(1 + \sin1). These are the same condition, because (1−sin⁡1)(1+sin⁡1)=cos⁡21(1 - \sin1)(1 + \sin1) = \cos^21.

Step 4 — so B=A1+sin⁡1cos⁡1B = A\tfrac{1 + \sin1}{\cos1} and f(x)=Acos⁡1(cos⁡1cos⁡x+sin⁡x+sin⁡1sin⁡x)=C(sin⁡x+cos⁡(x−1))f(x) = \tfrac{A}{\cos1}\left(\cos1\cos x + \sin x + \sin1\sin x\right) = C\left(\sin x + \cos(x - 1)\right) for an arbitrary constant CC. Check: f′(x)=C(cos⁡x−sin⁡(x−1))f'(x) = C(\cos x - \sin(x - 1)) and f(1−x)=C(sin⁡(1−x)+cos⁡x)f(1 - x) = C(\sin(1 - x) + \cos x), equal since sin⁡(1−x)=−sin⁡(x−1)\sin(1 - x) = -\sin(x - 1) ✓.

How to find it. Applying the reflection x↦1−xx \mapsto 1 - x twice is the identity, so differentiating twice returns to ff with a sign: a reflection condition hides a second-order equation, and the original condition then cuts the solution space in half.

Side note
Where it goes wrong

In the last example it is tempting to stop at Step 2: "f′′=−ff'' = -f, so f=Acos⁡x+Bsin⁡xf = A\cos x + B\sin x." That family is too big. Try f=sin⁡xf = \sin x: then f′(0)=1f'(0) = 1 while f(1−0)=sin⁡1≈0.84f(1 - 0) = \sin 1 \approx 0.84, so the original condition fails. Differentiating an equation produces a CONSEQUENCE of it, not an equivalent; every solution of the original solves f′′=−ff'' = -f, not conversely. The check against the original condition is not a formality — here it removes a whole dimension of false solutions.

Try it
Try it: an equation with a forcing term

Find all continuous ff with f(x)=ex+∫0xf(t) dtf(x) = e^x + \displaystyle\int_0^x f(t)\,dt.

Show the answer

ff is differentiable with f′=ex+ff' = e^x + f and f(0)=1f(0) = 1. Multiply by e−xe^{-x}: (fe−x)′=1(fe^{-x})' = 1, so fe−x=x+1fe^{-x} = x + 1 (the constant from f(0)=1f(0) = 1), and f(x)=(x+1)exf(x) = (x + 1)e^x. Check: ∫0x(t+1)et dt=xex\int_0^x(t + 1)e^t\,dt = xe^x, and ex+xex=(x+1)exe^x + xe^x = (x + 1)e^x ✓.

Comparison, Phase Lines and Blow-Up

Tip
Know the solution without solving

Phase line: for y′=g(y)y' = g(y), a solution never crosses an equilibrium (g(c)=0g(c) = 0), and between equilibria it is monotone. Comparison: if y′≥F(x,y)y' \ge F(x, y), z′=F(x,z)z' = F(x, z) and y(a)≥z(a)y(a) \ge z(a), then y≥zy \ge z for x≥ax \ge a (for FF with continuous partial derivative in yy). Blow-up: compare with an equation whose solution explodes, such as z′=1+z2z' = 1 + z^2 (z=tan⁡z = \tan).

All three rest on uniqueness. Two solutions of the same equation cannot meet (they would then coincide), so a solution that starts between two equilibria stays between them, and since gg keeps one sign there, it is monotone. For comparison, at a first point where yy would drop below zz the two would be equal with y′≥z′y' \ge z'; the smooth dependence of FF on yy turns that tangency into a contradiction (the careful version is Grönwall's inequality applied to z−yz - y). Blow-up follows: a function forced to stay above a solution that becomes infinite at x∗x^* cannot exist beyond x∗x^*.

Example
Worked: the logistic equation (folklore)
xy−3−2−112341y → 1
Solutions of y′ = y(1 − y) from y(0) = 0.1, 0.5, 1.6: none crosses the equilibria y = 0 and y = 1, and all approach 1.

Let y′=y(1−y)y' = y(1 - y) with y(0)=12y(0) = \tfrac12. Without solving, show that 0<y<10 < y < 1 for all xx, that yy is increasing, and that y→1y \to 1 as x→∞x \to \infty. Then solve.

Step 1 — equilibria: y≡0y \equiv 0 and y≡1y \equiv 1. A solution starting at 12\tfrac12 cannot reach either (uniqueness), so 0<y<10 < y < 1 as long as it exists.

Step 2 — there y′=y(1−y)>0y' = y(1 - y) > 0: yy is increasing and bounded, hence exists for all xx and has a limit L∈(12,1]L \in (\tfrac12, 1] as x→∞x \to \infty.

Step 3 — if L<1L < 1, then y′→L(1−L)>0y' \to L(1 - L) > 0, so yy would grow without bound: contradiction. So L=1L = 1.

Step 4 — solve: separate, dyy(1−y)=(1y+11−y)dy=dx\tfrac{dy}{y(1 - y)} = \left(\tfrac1y + \tfrac{1}{1 - y}\right)dy = dx, so ln⁡y1−y=x+c\ln\tfrac{y}{1 - y} = x + c, and y(0)=12y(0) = \tfrac12 gives c=0c = 0: y=11+e−xy = \tfrac{1}{1 + e^{-x}}, which indeed stays in (0,1)(0, 1), increases, and tends to 11.

How to find it. For an autonomous equation, draw the phase line first: the signs of gg between equilibria tell you where every solution goes, and the formula only confirms it.

Example
Worked: a Riccati equation that explodes (folklore)
xy1224x = 1 + π/2ytan(x − 1)
The numerical solution of y′ = x² + y² (solid) stays above tan(x − 1) (dashed) from x = 1, so it explodes before 1 + π/2 ≈ 2.57; in fact near x ≈ 2.00.

Let yy solve y′=x2+y2y' = x^2 + y^2 with y(0)=0y(0) = 0. Show that yy cannot be defined on all of [0,∞)[0, \infty): it becomes infinite before x=1+π2x = 1 + \tfrac\pi2.

Step 1 — y′=x2+y2≥0y' = x^2 + y^2 \ge 0, so yy is non-decreasing and y(x)≥y(0)=0y(x) \ge y(0) = 0 for x≥0x \ge 0.

Step 2 — for x≥1x \ge 1: y′≥1+y2y' \ge 1 + y^2, i.e. ddxarctan⁡y=y′1+y2≥1\tfrac{d}{dx}\arctan y = \tfrac{y'}{1 + y^2} \ge 1.

Step 3 — integrate from 11 to xx: arctan⁡y(x)≥arctan⁡y(1)+(x−1)≥x−1\arctan y(x) \ge \arctan y(1) + (x - 1) \ge x - 1, since y(1)≥0y(1) \ge 0.

Step 4 — arctan⁡\arctan is less than π2\tfrac\pi2, so the inequality is impossible once x−1≥π2x - 1 \ge \tfrac\pi2. Hence the solution cannot exist on [0,1+π2][0, 1 + \tfrac\pi2]: it becomes infinite at some x∗<1+π2≈2.571x^* < 1 + \tfrac\pi2 \approx 2.571. ■\blacksquare (Numerically x∗≈2.003x^* \approx 2.003; the comparison bound is crude but rigorous.)

How to find it. The y2y^2 term makes growth feed on itself; the x2x^2 term is only a nuisance, so bound it below by a constant on a half-line and compare with the equation z′=1+z2z' = 1 + z^2, whose solution tan⁡\tan is known to explode.

Side note
Where it goes wrong

"y′=3y2/3y' = 3y^{2/3} with y(0)=0y(0) = 0: y=0y = 0 is an equilibrium, so the solution stays at 00." But y=x3y = x^3 also solves it: 3(x3)2/3=3x2=(x3)′3(x^3)^{2/3} = 3x^2 = (x^3)'. Uniqueness — and with it the phase-line principle that solutions cannot leave an equilibrium — needs gg to be Lipschitz near the equilibrium (a bounded derivative suffices), and 3y2/33y^{2/3} has an infinite slope at y=0y = 0. Check the hypothesis before quoting the phase line.

Try it
Try it: explode before one

Let y′=y2−xy' = y^2 - x with y(0)=2y(0) = 2. Show that yy becomes infinite before x=1x = 1.

Show the answer

On [0,1][0, 1], y′≥y2−1y' \ge y^2 - 1. Compare with z′=z2−1z' = z^2 - 1, z(0)=2z(0) = 2. Separating, dzz2−1=dx\tfrac{dz}{z^2 - 1} = dx gives 12ln⁡z−1z+1=x−12ln⁡3\tfrac12\ln\tfrac{z - 1}{z + 1} = x - \tfrac12\ln3 (using z(0)=2z(0) = 2), so z−1z+1=e2x3\tfrac{z - 1}{z + 1} = \tfrac{e^{2x}}{3}, which reaches 11 — i.e. z=∞z = \infty — at x=ln⁡32≈0.549x = \tfrac{\ln3}{2} \approx 0.549. By comparison y≥zy \ge z as long as both exist, so yy becomes infinite no later than x=ln⁡32<1x = \tfrac{\ln 3}{2} < 1.

Proofs & Why It Matters

Tip
Proof: Grönwall's inequality

If u′(x)≤βu(x)u'(x) \le \beta u(x) on [0,T][0, T] with u(0)=u0u(0) = u_0, then u(x)≤u0eβxu(x) \le u_0e^{\beta x}.

Let v(x)=u(x)e−βxv(x) = u(x)e^{-\beta x}. Then v′=(u′−βu)e−βx≤0v' = (u' - \beta u)e^{-\beta x} \le 0, so vv is non-increasing and v(x)≤v(0)=u0v(x) \le v(0) = u_0, i.e. u(x)≤u0eβxu(x) \le u_0e^{\beta x}. ■\blacksquare Significance: Grönwall is how uniqueness of ODE solutions is actually proved (apply it to the square of the difference of two solutions), and it is the model for every "differential inequality ⇒\Rightarrow growth bound" argument.

Tip
Proof: blow-up for y′≥y2y' \ge y^2

If yy is differentiable with y′≥y2y' \ge y^2 and y(0)=c>0y(0) = c > 0, then yy cannot exist on [0,1/c][0, 1/c].

Since y′≥y2≥0y' \ge y^2 \ge 0, yy is non-decreasing, so y>0y > 0 wherever it exists and (−1y)′=y′y2≥1\left(-\tfrac1y\right)' = \tfrac{y'}{y^2} \ge 1. Integrating from 00 to xx: −1y(x)+1c≥x-\tfrac{1}{y(x)} + \tfrac1c \ge x, i.e. 1y(x)≤1c−x\tfrac{1}{y(x)} \le \tfrac1c - x, which is impossible once x≥1cx \ge \tfrac1c (the left side is positive). ■\blacksquare Significance: this comparison is the standard way to show that solutions of y′=y2+(anything≥0)y' = y^2 + (\text{anything} \ge 0) have finite lifetime — a favorite Putnam "prove that no such function exists on all of R\mathbb R."

Formulas, Proofs & Tips

Tip
Separable differential equations
dydx=g(x)h(y) ⟹ ∫dyh(y)=∫g(x) dx\frac{dy}{dx}=g(x)h(y) \ \Longrightarrow\ \int\frac{dy}{h(y)}=\int g(x)\,dx

What it means. Get all the yy's on one side and all the xx's on the other, then integrate both sides.

Example. dydx=xy\tfrac{dy}{dx}=xy: ∫dyy=∫x dx⇒ln⁡∣y∣=x22+C\int\tfrac{dy}{y}=\int x\,dx\Rightarrow \ln|y|=\tfrac{x^2}{2}+C.

Why it works. Dividing by h(y)h(y) and multiplying by dxdx separates the variables; integrating both sides is valid because each side is the derivative of the same quantity with respect to xx (a chain-rule substitution in reverse).

Tip. Apply the initial condition to find CC before simplifying — it is usually much less algebra.