Chapter VII · Additional theorems in the differential and integral calculus

Limits of the form 0/0

§154 35 min

Two methods for limits such as (tan⁡x−x)/(x−sin⁡x)(\tan x - x)/(x - \sin x), by comparing expansions and by the ratio of derivatives, and when each one applies.

Why this matters

Many limits come in a form where substituting the limiting value gives the meaningless "0/00/0": (sin⁡x)/x(\sin x)/x, (1−cos⁡x)/x2(1 - \cos x)/x^2, (tan⁡x−x)/(x−sin⁡x)(\tan x - x)/(x - \sin x) as x→0x \to 0. Every derivative is such a limit, and so are many questions about how fast one quantity vanishes compared with another. §154 gives two systematic methods. The first compares Taylor expansions; the second, which students know as L’Hôpital’s rule, replaces the ratio of the functions by the ratio of their derivatives. Knowing why each works tells you when it fails.

The idea

If f(0)=ϕ(0)=0f(0) = \phi(0) = 0, the ratio f(x)/ϕ(x)f(x)/\phi(x) near 00 depends on how fast each function vanishes. Taylor’s theorem answers that: near 00, each function behaves like the first non-zero term of its expansion. For example

tan⁡x−x=13x3+215x5+⋯ ,x−sin⁡x=16x3−1120x5+⋯ ,\tan x - x = \tfrac13 x^3 + \tfrac2{15}x^5 + \cdots, \qquad x - \sin x = \tfrac16 x^3 - \tfrac1{120}x^5 + \cdots,

so both vanish like x3x^3, and their ratio tends to 13/16=2\tfrac13 \big/ \tfrac16 = 2. Everything else in the expansions is small compared with the x3x^3 terms and disappears in the limit.

Explore Leading terms decide

Try this. For each example, read the two expansions, predict the limit from their leading terms, and check it against the graph and the table as the probe xx shrinks. Then choose the last example, x2sin⁡(1/x)/xx^2 \sin(1/x)/x, and switch on f′/ϕ′f'/\phi'.

tan⁡x−xx−sin⁡x\dfrac{\tan x - x}{x - \sin x} as x→0x \to 0 (Examples LVIII, 3)
x
  • f(x)/φ(x)
  • the limit
xf/φ
0.32.08408
0.032.00081
0.0032.000008
Numerator: tan⁡x−x=13x3+215x5+⋯\tan x - x = \tfrac13 x^3 + \tfrac{2}{15}x^5 + \cdots; denominator: x−sin⁡x=16x3−1120x5+⋯x - \sin x = \tfrac16 x^3 - \tfrac1{120}x^5 + \cdots.
The ratio of the leading terms gives the limit 22.
What to notice

Away from 00 the ratio can be far from its limit; only the leading terms matter as x→0x \to 0. In the last example the ratio itself squeezes to 00, but the ratio of derivatives, 2xsin⁡(1/x)−cos⁡(1/x)2x\sin(1/x) - \cos(1/x), swings between about −1-1 and 11 for ever. The derivative method can fail when the limit exists.

Precise statements

Hardy’s two methods differ in what they assume. The first needs derivatives at 00; the second needs derivatives near 00, and a limit for their ratio.

Theorem Method (a): the first non-vanishing derivatives Hardy: §154 (a)

Suppose that ff and ϕ\phi have nn derivatives at x=0x = 0, that f(k)(0)=ϕ(k)(0)=0f^{(k)}(0) = \phi^{(k)}(0) = 0 for 0≤k≤n−10 \le k \le n - 1, and that ϕ(n)(0)≠0\phi^{(n)}(0) \ne 0. Then

lim⁡x→0f(x)ϕ(x)=f(n)(0)ϕ(n)(0).\lim_{x \to 0} \frac{f(x)}{\phi(x)} = \frac{f^{(n)}(0)}{\phi^{(n)}(0)}.
Theorem Method (b): the ratio of derivatives (L'Hôpital's rule) Hardy: §154 (b), (3)

Suppose that ff and ϕ\phi are continuous on [0,h][0, h] and differentiable on (0,h](0, h], that f(0)=ϕ(0)=0f(0) = \phi(0) = 0, and that f′(x)/ϕ′(x)→lf'(x)/\phi'(x) \to l as x→+0x \to +0. Then f(x)/ϕ(x)→lf(x)/\phi(x) \to l as x→+0x \to +0. The same holds for x→−0x \to -0 and x→0x \to 0, with l=±∞l = \pm\infty, and, by repeating the argument, with f(n)/ϕ(n)f^{(n)}/\phi^{(n)} in place of f′/ϕ′f'/\phi' when the earlier derivatives vanish at 00.

The condition in (b) is sufficient, not necessary: f/ϕf/\phi may tend to a limit when f′/ϕ′f'/\phi' does not (the last example above). Other variants (limits as x→ax \to a or x→∞x \to \infty, or the form ∞/∞\infty/\infty) are usually reduced to these by a substitution such as x=a+tx = a + t or x=1/tx = 1/t.

In practice method (a) is usually applied through known expansions: if f(x)=anxn+o(xn)f(x) = a_n x^n + o(x^n) and ϕ(x)=bnxn+o(xn)\phi(x) = b_n x^n + o(x^n) with bn≠0b_n \ne 0, then f/ϕ→an/bnf/\phi \to a_n/b_n. The expansions of sin⁡\sin, cos⁡\cos, tan⁡\tan and so on can be multiplied and divided like polynomials, keeping track of the order of the error. Because an expansion with remainder o(xn)o(x^n) is unique (exercise below), any correct way of finding it gives the coefficients f(k)(0)/k!f^{(k)}(0)/k!.

Proofs

Proof Method (a)
Strategy

Expand both functions by the theorem of §151. Only the terms in xnx^n survive, and the common factor xn/n!x^n/n! cancels.

Expand

Since the first n−1n - 1 derivatives (and the values) vanish at 00,

f(x)=xnn!{f(n)(0)+η},ϕ(x)=xnn!{ϕ(n)(0)+η′},f(x) = \frac{x^n}{n!}\bigl\{f^{(n)}(0) + \eta\bigr\}, \qquad \phi(x) = \frac{x^n}{n!}\bigl\{\phi^{(n)}(0) + \eta'\bigr\},

where η,η′→0\eta, \eta' \to 0 as x→0x \to 0.

Divide

For small x≠0x \ne 0 we have ∣η′∣<∣ϕ(n)(0)∣|\eta'| < |\phi^{(n)}(0)|, so ϕ(x)≠0\phi(x) \ne 0 and

f(x)ϕ(x)=f(n)(0)+ηϕ(n)(0)+η′→f(n)(0)ϕ(n)(0).\frac{f(x)}{\phi(x)} = \frac{f^{(n)}(0) + \eta}{\phi^{(n)}(0) + \eta'} \to \frac{f^{(n)}(0)}{\phi^{(n)}(0)}.

Method (a) applied literally to (tan⁡x−x)/(x−sin⁡x)(\tan x - x)/(x - \sin x) needs three derivatives of each function: f′′′(0)=2f'''(0) = 2 and ϕ′′′(0)=1\phi'''(0) = 1. Method (b) needs only one step, because f′/ϕ′f'/\phi' simplifies at once: sec⁡2x−11−cos⁡x=sin⁡2xcos⁡2x (1−cos⁡x)=1+cos⁡xcos⁡2x→2\dfrac{\sec^2 x - 1}{1 - \cos x} = \dfrac{\sin^2 x}{\cos^2 x\,(1 - \cos x)} = \dfrac{1 + \cos x}{\cos^2 x} \to 2. That is Hardy’s reason for preferring (b) when the derivatives are simpler than the functions.

Proof Method (b)
Strategy

Cauchy’s mean value theorem (§128) turns the ratio f(x)/ϕ(x)=(f(x)−f(0))/(ϕ(x)−ϕ(0))f(x)/\phi(x) = \bigl(f(x) - f(0)\bigr)/\bigl(\phi(x) - \phi(0)\bigr) into a ratio of derivatives at some point ξ\xi between 00 and xx. As x→0x \to 0, ξ\xi is squeezed to 00 too. The only work is to make sure ϕ\phi does not vanish, so that the ratios make sense.

ϕ′\phi' has no zeros in some interval (0,k)(0, k)

The hypothesis that f′(x)/ϕ′(x)f'(x)/\phi'(x) tends to a limit presupposes that this ratio is defined for all small positive xx; so there is a kk with ϕ′(x)≠0\phi'(x) \ne 0 for 0<x<k0 < x < k.

Hence ϕ(x)≠0\phi(x) \ne 0 for 0<x<k0 < x < k

A derivative that never vanishes on an interval keeps one sign there (Darboux’s theorem, §129). So ϕ\phi is strictly monotone on (0,k)(0, k) and, since ϕ(0)=0\phi(0) = 0 and ϕ\phi is continuous, ϕ(x)≠0\phi(x) \ne 0 for 0<x<k0 < x < k.

Apply Cauchy's mean value theorem on [0,x][0, x]

For 0<x<k0 < x < k there is a ξ\xi with 0<ξ<x0 < \xi < x and

f(x)ϕ(x)=f(x)−f(0)ϕ(x)−ϕ(0)=f′(ξ)ϕ′(ξ).\frac{f(x)}{\phi(x)} = \frac{f(x) - f(0)}{\phi(x) - \phi(0)} = \frac{f'(\xi)}{\phi'(\xi)}.

Let x→+0x \to +0

Given ε>0\varepsilon > 0, choose δ≤k\delta \le k so that ∣f′(t)/ϕ′(t)−l∣<ε|f'(t)/\phi'(t) - l| < \varepsilon for 0<t<δ0 < t < \delta. If 0<x<δ0 < x < \delta then 0<ξ<δ0 < \xi < \delta, so ∣f(x)/ϕ(x)−l∣<ε|f(x)/\phi(x) - l| < \varepsilon. Hence f(x)/ϕ(x)→lf(x)/\phi(x) \to l.

Notice where the converse breaks: the point ξ\xi depends on xx in an uncontrolled way, so knowing f′(ξ)/ϕ′(ξ)f'(\xi)/\phi'(\xi) only at these special points says nothing about f′/ϕ′f'/\phi' at all points near 00.

Worked examples and exercises

Exercise Expansions are unique ●○○ Hardy: Examples LVI, 1

Show that if a0+a1x+⋯+anxn+o(xn)=b0+b1x+⋯+bnxn+o(xn)a_0 + a_1 x + \cdots + a_n x^n + o(x^n) = b_0 + b_1 x + \cdots + b_n x^n + o(x^n) as x→0x \to 0, then ak=bka_k = b_k for every kk. Deduce that if ff has nn derivatives at 00 and f(x)=c0+c1x+⋯+cnxn+o(xn)f(x) = c_0 + c_1 x + \cdots + c_n x^n + o(x^n), then ck=f(k)(0)/k!c_k = f^{(k)}(0)/k!.

Hint
Let x→0x \to 0. Then divide by xx and let x→0x \to 0 again.

Solution

Subtract: (a0−b0)+(a1−b1)x+⋯+(an−bn)xn=o(xn)(a_0 - b_0) + (a_1 - b_1)x + \cdots + (a_n - b_n)x^n = o(x^n). Letting x→0x \to 0 gives a0=b0a_0 = b_0. Cancel those terms, divide by xx, and let x→0x \to 0: a1=b1a_1 = b_1. Continue nn times (each division by xx keeps the right side o(xn−k)o(x^{n-k})). For the second part, §151 gives one expansion with ck=f(k)(0)/k!c_k = f^{(k)}(0)/k!; by uniqueness every other expansion has the same coefficients.

Exercise ●●○ Hardy: Examples LVIII, 2

Find the limit of x−(n+1)xn+1+nxn+2(1−x)2\dfrac{x - (n+1)x^{n+1} + n x^{n+2}}{(1 - x)^2} as x→1x \to 1.

Hint
Put x=1+tx = 1 + t, or use method (a) at x=1x = 1: check the values and first derivatives of numerator and denominator there.
Hint
Alternatively: the expression equals x+2x2+⋯+nxnx + 2x^2 + \cdots + nx^n for x≠1x \ne 1.

Solution

Let g(x)=x−(n+1)xn+1+nxn+2g(x) = x - (n+1)x^{n+1} + nx^{n+2}. Then g(1)=1−(n+1)+n=0g(1) = 1 - (n + 1) + n = 0; g′(x)=1−(n+1)2xn+n(n+2)xn+1g'(x) = 1 - (n+1)^2 x^n + n(n+2)x^{n+1}, so g′(1)=1−(n+1)2+n(n+2)=0g'(1) = 1 - (n+1)^2 + n(n+2) = 0; and g′′(x)=−n(n+1)2xn−1+n(n+1)(n+2)xng''(x) = -n(n+1)^2x^{n-1} + n(n+1)(n+2)x^n, so g′′(1)=n(n+1)g''(1) = n(n+1). The denominator (1−x)2(1 - x)^2 has value and first derivative 00 at 11 and second derivative 22. By method (a) (at x=1x = 1) the limit is n(n+1)/2n(n+1)/2.

This agrees with the second hint: the expression is ∑k=1nkxk\sum_{k=1}^n kx^k, whose value at x=1x = 1 is 1+2+⋯+n=12n(n+1)1 + 2 + \cdots + n = \tfrac12 n(n+1).

Exercise ●○○ Hardy: Examples LVIII, 5

Find the limit of x{x2+a2−x}x\{\sqrt{x^2 + a^2} - x\} as x→∞x \to \infty.

Hint
Hardy suggests x=1/yx = 1/y, which turns it into a 0/00/0 form as y→+0y \to +0.

Solution

With x=1/yx = 1/y (y>0y > 0) the expression is 1+a2y2−1y2\dfrac{\sqrt{1 + a^2y^2} - 1}{y^2}. Now 1+u=1+12u+o(u)\sqrt{1 + u} = 1 + \tfrac12 u + o(u), so the numerator is 12a2y2+o(y2)\tfrac12 a^2y^2 + o(y^2) and the limit is 12a2\tfrac12 a^2. (Without calculus: multiply and divide by x2+a2+x\sqrt{x^2 + a^2} + x to get a2x/(x2+a2+x)→a2/2a^2x/(\sqrt{x^2 + a^2} + x) \to a^2/2.)

Exercise ●●○ Hardy: Examples LVIII, 7

Find the limits as x→0x \to 0 of 1x3(cosec⁡x−1x−x6)\dfrac{1}{x^3}\Bigl(\operatorname{cosec} x - \dfrac1x - \dfrac x6\Bigr) and 1x3(cot⁡x−1x+x3)\dfrac{1}{x^3}\Bigl(\cot x - \dfrac1x + \dfrac x3\Bigr).

Hint
Write cosec⁡x=1x(1−x26+x4120−⋯ )−1\operatorname{cosec} x = \dfrac{1}{x}\Bigl(1 - \dfrac{x^2}{6} + \dfrac{x^4}{120} - \cdots\Bigr)^{-1} and expand (1−u)−1=1+u+u2+⋯(1 - u)^{-1} = 1 + u + u^2 + \cdots with u=x2/6−x4/120+O(x6)u = x^2/6 - x^4/120 + O(x^6).

Solution

With u=x26−x4120+O(x6)u = \frac{x^2}{6} - \frac{x^4}{120} + O(x^6) we get u+u2=x26+x4(136−1120)+O(x6)=x26+7x4360+O(x6)u + u^2 = \frac{x^2}{6} + x^4\bigl(\frac{1}{36} - \frac{1}{120}\bigr) + O(x^6) = \frac{x^2}{6} + \frac{7x^4}{360} + O(x^6). So cosec⁡x=1x+x6+7x3360+O(x5)\operatorname{cosec} x = \frac1x + \frac x6 + \frac{7x^3}{360} + O(x^5), and the first limit is 7360\frac{7}{360}.

For the cotangent, cot⁡x=cos⁡xcosec⁡x=(1−x22+x424)(1x+x6+7x3360)+O(x5)=1x+x(16−12)+x3(7360−112+124)+O(x5)\cot x = \cos x \operatorname{cosec} x = \bigl(1 - \frac{x^2}{2} + \frac{x^4}{24}\bigr)\bigl(\frac1x + \frac x6 + \frac{7x^3}{360}\bigr) + O(x^5) = \frac1x + x\bigl(\frac16 - \frac12\bigr) + x^3\bigl(\frac{7}{360} - \frac{1}{12} + \frac1{24}\bigr) + O(x^5). The coefficients are −13-\frac13 and 7−30+15360=−8360=−145\frac{7 - 30 + 15}{360} = -\frac{8}{360} = -\frac1{45}. So the second limit is −145-\frac1{45}.

Exercise ●●○ Hardy: Examples LVIII, 8

Show that (sin⁡xarcsin⁡x−x2)/x6→118(\sin x \arcsin x - x^2)/x^6 \to \tfrac1{18} and (tan⁡xarctan⁡x−x2)/x6→29(\tan x \arctan x - x^2)/x^6 \to \tfrac29 as x→0x \to 0.

Hint
You need arcsin⁡x=x+x36+3x540+O(x7)\arcsin x = x + \frac{x^3}{6} + \frac{3x^5}{40} + O(x^7), tan⁡x=x+x33+2x515+O(x7)\tan x = x + \frac{x^3}{3} + \frac{2x^5}{15} + O(x^7) and arctan⁡x=x−x33+x55+O(x7)\arctan x = x - \frac{x^3}{3} + \frac{x^5}{5} + O(x^7). Multiply, keeping terms up to x6x^6.

Solution

sin⁡xarcsin⁡x=(x−x36+x5120)(x+x36+3x540)+O(x8)\sin x \arcsin x = \bigl(x - \frac{x^3}{6} + \frac{x^5}{120}\bigr)\bigl(x + \frac{x^3}{6} + \frac{3x^5}{40}\bigr) + O(x^8). The x4x^4 coefficient is 16−16=0\frac16 - \frac16 = 0, and the x6x^6 coefficient is 340−136+1120=27−10+3360=118\frac{3}{40} - \frac1{36} + \frac1{120} = \frac{27 - 10 + 3}{360} = \frac{1}{18}. So the first limit is 118\frac1{18}.

tan⁡xarctan⁡x=(x+x33+2x515)(x−x33+x55)+O(x8)\tan x \arctan x = \bigl(x + \frac{x^3}{3} + \frac{2x^5}{15}\bigr)\bigl(x - \frac{x^3}{3} + \frac{x^5}{5}\bigr) + O(x^8). The x4x^4 coefficient is again 00, and the x6x^6 coefficient is 15−19+215=9−5+645=29\frac15 - \frac19 + \frac{2}{15} = \frac{9 - 5 + 6}{45} = \frac{2}{9}.

Method (b) would need six differentiations of each product: expansions are far quicker.

Check yourself

Check yourself True or false?

If f(0)=ϕ(0)=0f(0) = \phi(0) = 0 and f(x)/ϕ(x)→lf(x)/\phi(x) \to l as x→0x \to 0, then f′(x)/ϕ′(x)→lf'(x)/\phi'(x) \to l as well.

Why

False. Hardy’s Examples LVIII, 1: f=x2sin⁡(1/x)f = x^2\sin(1/x), ϕ=x\phi = x. Then f/ϕ=xsin⁡(1/x)→0f/\phi = x\sin(1/x) \to 0, but f′/ϕ′=2xsin⁡(1/x)−cos⁡(1/x)f'/\phi' = 2x\sin(1/x) - \cos(1/x) oscillates. The rule only goes one way.

Check yourself Enter a number

What is lim⁡x→0x−sin⁡xx3\displaystyle\lim_{x \to 0} \frac{x - \sin x}{x^3}?

Why

x−sin⁡x=x36−x5120+⋯x - \sin x = \frac{x^3}{6} - \frac{x^5}{120} + \cdots, so the limit is 16\frac16. (Method (a): the third derivatives at 00 are 11 and 66.)

Check yourself Choose one

A student computes lim⁡x→0sin⁡xx+1\displaystyle\lim_{x\to 0}\frac{\sin x}{x + 1} “by L’Hôpital” as lim⁡cos⁡x1=1\displaystyle\lim \frac{\cos x}{1} = 1. What is wrong?

Why

The proof of method (b) uses f(0)=ϕ(0)=0f(0) = \phi(0) = 0 to write f/ϕf/\phi as a ratio of increments. Here ϕ(0)=1\phi(0) = 1, and the function is simply continuous at 00, with value 00. Always check the form before differentiating.

Check yourself Enter a number

What is lim⁡x→0tan⁡3x−3tan⁡x3sin⁡x−sin⁡3x\displaystyle\lim_{x \to 0} \frac{\tan 3x - 3\tan x}{3\sin x - \sin 3x}? (Examples LVIII, 3.)

Why

tan⁡3x−3tan⁡x=27−33x3+⋯=8x3+⋯\tan 3x - 3\tan x = \frac{27 - 3}{3}x^3 + \cdots = 8x^3 + \cdots and 3sin⁡x−sin⁡3x=27−36x3+⋯=4x3+⋯3\sin x - \sin 3x = \frac{27 - 3}{6}x^3 + \cdots = 4x^3 + \cdots, so the limit is 22. The same happens with any n≠0,±1n \ne 0, \pm1 in place of 33: the ratio is (n3−n)/3(n3−n)/6=2\frac{(n^3 - n)/3}{(n^3 - n)/6} = 2.

Hardy’s language

Summary

Summary
  • For 0/00/0 at x=0x = 0: if the first non-vanishing derivatives of ff and ϕ\phi have the same order nn, the limit is f(n)(0)/ϕ(n)(0)f^{(n)}(0)/\phi^{(n)}(0); in practice, compare the leading terms of the expansions.
  • L’Hôpital: if f(0)=ϕ(0)=0f(0) = \phi(0) = 0 and f′/ϕ′→lf'/\phi' \to l, then f/ϕ→lf/\phi \to l; proved by Cauchy’s mean value theorem.
  • The rule is sufficient, not necessary: x2sin⁡(1/x)/x→0x^2\sin(1/x)/x \to 0 while f′/ϕ′f'/\phi' oscillates. And it applies only to genuine 0/00/0 (or ∞/∞\infty/\infty) forms.
  • Expansions with remainder o(xn)o(x^n) are unique, so they can be found by any correct algebra on known series.