Chapter V · Limits of functions of a continuous variable. Continuous and discontinuous functions

Orders of smallness and greatness

§98 25 min

Comparing how fast functions tend to 00 or ∞\infty with OO, oo and ∼\sim, and measuring the speed against the scale x,x2,x3,…x, x^2, x^3, \dots

Why this matters

sin⁡x\sin x, 1−cos⁡x1 - \cos x and tan⁡x−sin⁡x\tan x - \sin x all tend to 00 as x→0x \to 0, but at very different speeds. Knowing how fast is often more useful than knowing the limit: it tells you which terms of a formula can be neglected, and it is exactly the language of derivatives (“f(a+h)−f(a)−hf′(a)f(a + h) - f(a) - hf'(a) is small compared with hh”) and of Taylor’s theorem. In §98 Hardy carries the symbols OO, oo and ∼\sim of §89 over to functions of xx, and introduces a ruler for speed: the powers x,x2,x3,…x, x^2, x^3, \dots

The idea

To measure how fast ϕ(x)→0\phi(x) \to 0, divide it by a power of xx and see what is left. If ϕ(x)/xm\phi(x)/x^m tends to a finite, non-zero limit, then near 00 the function behaves like a constant times xmx^m, and we say it is of the mmth order of smallness.

Each power tends to 00 faster than the one before (xm+1/xm=x→0x^{m+1}/x^m = x \to 0), so the test is sharp: divide by too small a power and the ratio still tends to 00; divide by too large a power and it blows up. Exactly one mm, if any, gives a finite non-zero limit.

Explore Find the order

Try this. With ϕ=1−cos⁡x\phi = 1 - \cos x, move mm from 00 upwards and watch what the ratio does near the left edge, x→0x \to 0. Then find the order of tan⁡x−sin⁡x\tan x - \sin x, of cosec⁡x−cot⁡x\operatorname{cosec} x - \cot x and of x7/5x^{7/5}. Finally try xsin⁡(1/x)x\sin(1/x).

The ratio ϕ(x)xm\dfrac{\phi(x)}{x^{m}} with ϕ(x)=1−cos⁡x\phi(x) = 1-\cos x, m=1m = 1, for 0<x≤10 < x \le 1
xφ(x)/xᵐ
  • φ(x)/xᵐ
  • its limit as x → +0 (when it is not 0)
At x=0.01x = 0.01 the ratio is 0.0050.005; at x=0.001x = 0.001 it is 0.00050.0005. The ratio tends to 00: φ is smaller than x1x^{1}, i.e. ϕ=o(x1)\phi = o(x^{1}). Increase m.
What to notice

Below the right mm the curve dives to 00 at the left edge; above it, the curve shoots off to infinity; at the right mm it settles on a dashed level: 12\tfrac12 for 1−cos⁡x1 - \cos x at m=2m = 2, 12\tfrac12 for tan⁡x−sin⁡x\tan x - \sin x at m=3m = 3. x7/5x^{7/5} needs a fractional mm. And xsin⁡(1/x)x\sin(1/x) has no order: at m=1m = 1 the ratio is sin⁡(1/x)\sin(1/x), which is bounded but never settles.

The last example is a warning that the scale of powers is a crude ruler. Some functions fall between its marks (x7/5x^{7/5} is smaller than xx but larger than x2x^2), and some cannot be measured by it at all. Hardy adds that even fractional powers will not make the scale complete: Chapter IX shows that 1/log⁡(1/x)1/\log(1/x) tends to 00 more slowly than every positive power of xx.

Precise statements

Definition OO, oo and ∼\sim for a continuous variable Hardy: §98 (from §89)

Let ϕ(x)>0\phi(x) > 0 near the relevant limit. As x→∞x \to \infty (or as x→ax \to a):

  • f=O(ϕ)f = O(\phi) if there is a constant KK with ∣f(x)∣<Kϕ(x)|f(x)| < K\phi(x) for all sufficiently large xx (for all x≠ax \ne a sufficiently near aa);
  • f=o(ϕ)f = o(\phi) if f(x)/ϕ(x)→0f(x)/\phi(x) \to 0;
  • f∼lϕf \sim l\phi, where l≠0l \ne 0, if f(x)/ϕ(x)→lf(x)/\phi(x) \to l.

For example, as x→∞x \to \infty:   x+x2=O(x2)\;x + x^2 = O(x^2),   x=o(x2)\;x = o(x^2),   x+x2∼x2\;x + x^2 \sim x^2,   sin⁡x=O(1)\;\sin x = O(1),   x−1/2=o(1)\;x^{-1/2} = o(1); and as x→0x \to 0:   x+x2=O(x)\;x + x^2 = O(x),   x2=o(x)\;x^2 = o(x),   x+x2∼x\;x + x^2 \sim x,   sin⁡(1/x)=O(1)\;\sin(1/x) = O(1),   x1/2=o(1)\;x^{1/2} = o(1). Note that f=o(1)f = o(1) just says f→0f \to 0, and f=O(1)f = O(1) says ff is bounded.

Definition Orders of smallness and greatness Hardy: §98

As x→0x \to 0, ϕ(x)\phi(x) is of the mmth order of smallness if ϕ(x)/xm→l\phi(x)/x^m \to l with l≠0l \ne 0, that is, ϕ(x)∼lxm\phi(x) \sim l x^m. It is of the mmth order of greatness if xmϕ(x)→l≠0x^m\phi(x) \to l \ne 0. As x→∞x \to \infty the roles of xmx^m and x−mx^{-m} are exchanged (order of smallness mm means xmϕ(x)→l≠0x^m\phi(x) \to l \ne 0), and as x→ax \to a we use powers of x−ax - a.

For integer mm this works for x→0x \to 0 from both sides; for fractional mm we take x→+0x \to +0 so that xmx^m is defined.

Theorem The order is unique, and adds under multiplication

Let ϕ∼lxm\phi \sim l x^m and ψ∼l′xn\psi \sim l' x^n as x→+0x \to +0, with l,l′≠0l, l' \ne 0. Then:

  1. ϕ(x)/xp→0\phi(x)/x^{p} \to 0 for every p<mp < m and ∣ϕ(x)/xp∣→∞|\phi(x)/x^{p}| \to \infty for every p>mp > m; so ϕ\phi has only one order.
  2. ϕψ∼ll′xm+n\phi\psi \sim ll' x^{m+n}: the orders add.
  3. If m<nm < n then ϕ+ψ∼lxm\phi + \psi \sim l x^m: the smaller order wins. If m=nm = n and l+l′≠0l + l' \ne 0 then ϕ+ψ∼(l+l′)xm\phi + \psi \sim (l + l')x^m.

When m=nm = n and l+l′=0l + l' = 0 the leading terms cancel and the sum is of higher order, or has no order at all: tan⁡x∼x\tan x \sim x and sin⁡x∼x\sin x \sim x, yet tan⁡x−sin⁡x∼12x3\tan x - \sin x \sim \tfrac12 x^3.

Proofs

Proof The order is unique, and adds under multiplication
Strategy

Every statement comes from writing the ratio in question as a product or sum of ratios whose limits we know, and using the algebra of limits from the last lesson.

Below the order: the ratio tends to 00

For p<mp < m, ϕ(x)xp=ϕ(x)xm⋅xm−p\dfrac{\phi(x)}{x^p} = \dfrac{\phi(x)}{x^m}\cdot x^{m - p}. The first factor tends to ll, the second to 00 (a positive power of xx), so the product tends to l⋅0=0l \cdot 0 = 0.

Above the order: the ratio tends to ∞\infty

For p>mp > m, ∣ϕ(x)xp∣=∣ϕ(x)xm∣⋅1xp−m\left|\dfrac{\phi(x)}{x^p}\right| = \left|\dfrac{\phi(x)}{x^m}\right| \cdot \dfrac{1}{x^{p - m}}. Near 00 the first factor exceeds 12∣l∣>0\tfrac12|l| > 0, and the second tends to +∞+\infty. So the product tends to +∞+\infty. In particular no p≠mp \ne m gives a finite non-zero limit.

Products

ϕψxm+n=ϕxm⋅ψxn→ll′≠0\dfrac{\phi\psi}{x^{m+n}} = \dfrac{\phi}{x^m}\cdot\dfrac{\psi}{x^n} \to ll' \ne 0.

Sums

ϕ+ψxm=ϕxm+ψxn xn−m\dfrac{\phi + \psi}{x^m} = \dfrac{\phi}{x^m} + \dfrac{\psi}{x^n}\,x^{n - m}. If n>mn > m the last term tends to l′⋅0l' \cdot 0, so the sum tends to ll. If n=mn = m it tends to l+l′l + l', which is a valid order-mm limit only when l+l′≠0l + l' \ne 0.

Worked examples and exercises

Exercise Three equivalences ●○○ Hardy: §98

Show that, as x→0x \to 0,   sin⁡αx∼αx\;\sin\alpha x \sim \alpha x (for α≠0\alpha \ne 0),   1−cos⁡x∼12x2\;1 - \cos x \sim \tfrac12 x^2 and   cosec⁡x−cot⁡x∼12x\;\operatorname{cosec} x - \cot x \sim \tfrac12 x. What are the orders of smallness?

Hint
All three reduce to (sin⁡t)/t→1(\sin t)/t \to 1. For the last, write cosec⁡x−cot⁡x=(1−cos⁡x)/sin⁡x\operatorname{cosec} x - \cot x = (1 - \cos x)/\sin x.

Solution

First. (sin⁡αx)/(αx)→1(\sin\alpha x)/(\alpha x) \to 1, putting t=αxt = \alpha x. Order 11.

Second. (1−cos⁡x)/x2→12(1 - \cos x)/x^2 \to \tfrac12 (last lesson). Order 22.

Third. cosec⁡x−cot⁡x=1−cos⁡xsin⁡x=1−cos⁡xx2⋅xsin⁡x⋅x\operatorname{cosec} x - \cot x = \dfrac{1 - \cos x}{\sin x} = \dfrac{1 - \cos x}{x^2}\cdot\dfrac{x}{\sin x}\cdot x. Dividing by xx, the ratio tends to 12⋅1=12\tfrac12 \cdot 1 = \tfrac12. Order 11. (In fact cosec⁡x−cot⁡x=tan⁡12x\operatorname{cosec} x - \cot x = \tan\tfrac12 x exactly.)

Exercise Cancellation raises the order ●●○ Hardy: §98

Show that tan⁡x−sin⁡x\tan x - \sin x is of the third order of smallness as x→0x \to 0, with (tan⁡x−sin⁡x)/x3→12(\tan x - \sin x)/x^3 \to \tfrac12.

Hint
Factor: tan⁡x−sin⁡x=tan⁡x (1−cos⁡x)\tan x - \sin x = \tan x\,(1 - \cos x).

Solution

tan⁡x−sin⁡x=sin⁡x(1cos⁡x−1)=tan⁡x (1−cos⁡x)\tan x - \sin x = \sin x\left(\dfrac{1}{\cos x} - 1\right) = \tan x\,(1 - \cos x). Hence

tan⁡x−sin⁡xx3=sin⁡xx⋅1cos⁡x⋅1−cos⁡xx2→1⋅1⋅12=12,\frac{\tan x - \sin x}{x^3} = \frac{\sin x}{x}\cdot\frac{1}{\cos x}\cdot\frac{1 - \cos x}{x^2} \to 1 \cdot 1 \cdot \tfrac12 = \tfrac12,

using cos⁡x→1\cos x \to 1, which follows from 1−cos⁡x=2sin⁡212x<12x21 - \cos x = 2\sin^2\tfrac12 x < \tfrac12 x^2. The two terms are each of order 11, but their leading parts xx and xx cancel.

Exercise Bounded ratio, but no order ●●○ Hardy: §98, footnote

Show that xsin⁡(1/x)x\sin(1/x) is O(x)O(x) as x→0x \to 0 but is not of any order of smallness. Hardy remarks that a wider definition (“A∣x∣m≤∣ϕ(x)∣≤B∣x∣mA|x|^m \le |\phi(x)| \le B|x|^m for positive constants AA, BB”) is sometimes used. Does x{2+sin⁡(1/x)}x\{2 + \sin(1/x)\} have order 11 in the wider sense? In Hardy’s sense?

Hint
For m=1m = 1 the ratio is sin⁡(1/x)\sin(1/x). For other mm, use part 1 of the theorem’s proof idea: multiply by a power of xx.

Solution

∣xsin⁡(1/x)∣≤∣x∣|x\sin(1/x)| \le |x|, so it is O(x)O(x) with K=2K = 2, say. At m=1m = 1 the ratio sin⁡(1/x)\sin(1/x) oscillates between −1-1 and 11, so it has no limit. For m<1m < 1 the ratio x1−msin⁡(1/x)→0x^{1-m}\sin(1/x) \to 0; for m>1m > 1 it is sin⁡(1/x)/xm−1\sin(1/x)/x^{m-1}, which is 00 at x=1/(kπ)x = 1/(k\pi) and huge at x=1/(2kπ+12π)x = 1/(2k\pi + \tfrac12\pi), so it has no limit either. No mm gives a non-zero limit.

For ϕ=x{2+sin⁡(1/x)}\phi = x\{2 + \sin(1/x)\}: ∣x∣≤∣ϕ(x)∣≤3∣x∣|x| \le |\phi(x)| \le 3|x|, so it has order 11 in the wider sense. But ϕ(x)/x=2+sin⁡(1/x)\phi(x)/x = 2 + \sin(1/x) oscillates between 11 and 33, so it is not of order 11 in the sense of the text, and (as above) of no other order.

Exercise ●●○ Hardy: Misc. Examples V, 6

Show that, as x→∞x \to \infty,

x+a=x+12ax−1/2(1+η),\sqrt{x + a} = \sqrt{x} + \tfrac12 a x^{-1/2}(1 + \eta),

where η\eta is of the first order of smallness (for a≠0a \ne 0).

Hint
x+a−x=a/{x+a+x}\sqrt{x + a} - \sqrt{x} = a/\{\sqrt{x + a} + \sqrt{x}\}. Solve for η\eta.
Hint
You should find xη→−14ax\eta \to -\tfrac14 a.

Solution

The identity defines η\eta: 1+η=2xa(x+a−x)=2xx+a+x=21+s1 + \eta = \dfrac{2\sqrt{x}}{a}(\sqrt{x + a} - \sqrt{x}) = \dfrac{2\sqrt{x}}{\sqrt{x + a} + \sqrt{x}} = \dfrac{2}{1 + s}, where s=1+a/xs = \sqrt{1 + a/x}. So

η=1−s1+s=1−s2(1+s)2=−a/x(1+s)2.\eta = \frac{1 - s}{1 + s} = \frac{1 - s^2}{(1 + s)^2} = \frac{-a/x}{(1 + s)^2}.

As x→∞x \to \infty, s→1s \to 1, so xη=−a/(1+s)2→−14a≠0x\eta = -a/(1 + s)^2 \to -\tfrac14 a \ne 0. By the definition for x→∞x \to \infty, η\eta is of the first order of smallness.

Check yourself

Check yourself Choose one

Which is true?

Why

OO, oo and ∼\sim only make sense relative to a limit of xx. Near 00, x2/x=x→0x^2/x = x \to 0; near ∞\infty, x/x2=1/x→0x/x^2 = 1/x \to 0. Small powers are big near ∞\infty and small near 00.

Check yourself Enter a number

What is the order of smallness of (1−cos⁡x)2(1 - \cos x)^2 as x→0x \to 0?

Why

1−cos⁡x1 - \cos x is of order 22, and orders add under multiplication: (1−cos⁡x)2∼14x4(1 - \cos x)^2 \sim \tfrac14 x^4, of order 44.

Check yourself True or false?

If ϕ\phi and ψ\psi are both of the first order of smallness as x→0x \to 0, then so is ϕ−ψ\phi - \psi.

Why

False. The leading terms can cancel: tan⁡x\tan x and sin⁡x\sin x are both ∼x\sim x, but tan⁡x−sin⁡x∼12x3\tan x - \sin x \sim \tfrac12 x^3. The theorem only guarantees order mm for the sum when l+l′≠0l + l' \ne 0.

Check yourself Choose one

As x→∞x \to \infty, f(x)=x(2+sin⁡x)f(x) = x(2 + \sin x). Which is correct?

Why

x≤f(x)≤3xx \le f(x) \le 3x, so f=O(x)f = O(x). But f(x)/x=2+sin⁡xf(x)/x = 2 + \sin x oscillates between 11 and 33, so it has no limit: there is no ll with f∼lxf \sim lx, and ff has no order of greatness in Hardy’s sense. OO only bounds; ∼\sim needs a limit.

Hardy’s language

Summary

Summary
  • f=O(ϕ)f = O(\phi): ∣f∣|f| is at most a constant times ϕ\phi; f=o(ϕ)f = o(\phi): f/ϕ→0f/\phi \to 0; f∼lϕf \sim l\phi: f/ϕ→l≠0f/\phi \to l \ne 0. Each is relative to a stated limit of xx.
  • ϕ\phi has order of smallness mm at 00 when ϕ(x)/xm\phi(x)/x^m tends to a finite non-zero limit; the order, if it exists, is unique.
  • Orders add under products; under sums the smaller order wins, unless the leading terms cancel.
  • Standard facts: sin⁡x∼x\sin x \sim x, 1−cos⁡x∼12x21 - \cos x \sim \tfrac12 x^2, tan⁡x−sin⁡x∼12x3\tan x - \sin x \sim \tfrac12 x^3, cosec⁡x−cot⁡x∼12x\operatorname{cosec} x - \cot x \sim \tfrac12 x.
  • The scale of powers is incomplete: some functions have fractional order, some (like xsin⁡(1/x)x\sin(1/x)) have none.