sinx, 1−cosx and tanx−sinx all tend to 0 as x→0, but at very different speeds. Knowing how fast is often more useful than knowing the limit: it tells you which terms of a formula can be neglected, and it is exactly the language of derivatives (“f(a+h)−f(a)−hf′(a) is small compared with h”) and of Taylor’s theorem. In §98 Hardy carries the symbols O, o and ∼ of §89 over to functions of x, and introduces a ruler for speed: the powers x,x2,x3,…
The idea
To measure how fast ϕ(x)→0, divide it by a power of x and see what is left. If ϕ(x)/xm tends to a finite, non-zero limit, then near 0 the function behaves like a constant times xm, and we say it is of the mth order of smallness.
Each power tends to 0 faster than the one before (xm+1/xm=x→0), so the test is sharp: divide by too small a power and the ratio still tends to 0; divide by too large a power and it blows up. Exactly one m, if any, gives a finite non-zero limit.
ExploreFind the order
Try this.With ϕ=1−cosx, move m from 0 upwards and watch what the ratio does near the left edge, x→0. Then find the order of tanx−sinx, of cosecx−cotx and of x7/5. Finally try xsin(1/x).
The ratio xmϕ(x) with ϕ(x)=1−cosx, m=1, for 0<x≤1
xφ(x)/xᵐ
φ(x)/xᵐ
its limit as x → +0 (when it is not 0)
At x=0.01 the ratio is 0.005; at x=0.001 it is 0.0005. The ratio tends to 0: φ is smaller than x1, i.e. ϕ=o(x1). Increase m.
What to notice
Below the right m the curve dives to 0 at the left edge; above it, the curve shoots off to infinity; at the right m it settles on a dashed level: 21 for 1−cosx at m=2, 21 for tanx−sinx at m=3. x7/5 needs a fractional m. And xsin(1/x) has no order: at m=1 the ratio is sin(1/x), which is bounded but never settles.
The last example is a warning that the scale of powers is a crude ruler. Some functions fall between its marks (x7/5 is smaller than x but larger than x2), and some cannot be measured by it at all. Hardy adds that even fractional powers will not make the scale complete: Chapter IX shows that 1/log(1/x) tends to 0 more slowly than every positive power of x.
Precise statements
DefinitionO, o and ∼ for a continuous variableHardy: §98 (from §89)
Let ϕ(x)>0 near the relevant limit. As x→∞ (or as x→a):
f=O(ϕ) if there is a constant K with ∣f(x)∣<Kϕ(x) for all sufficiently large x (for all x=a sufficiently near a);
f=o(ϕ) if f(x)/ϕ(x)→0;
f∼lϕ, where l=0, if f(x)/ϕ(x)→l.
For example, as x→∞:
x+x2=O(x2), x=o(x2), x+x2∼x2, sinx=O(1), x−1/2=o(1);
and as x→0:
x+x2=O(x), x2=o(x), x+x2∼x, sin(1/x)=O(1), x1/2=o(1).
Note that f=o(1) just says f→0, and f=O(1) says f is bounded.
DefinitionOrders of smallness and greatnessHardy: §98
As x→0, ϕ(x) is of the mth order of smallness if ϕ(x)/xm→l with l=0, that is, ϕ(x)∼lxm. It is of the mth order of greatness if xmϕ(x)→l=0. As x→∞ the roles of xm and x−m are exchanged (order of smallness m means xmϕ(x)→l=0), and as x→a we use powers of x−a.
For integer m this works for x→0 from both sides; for fractional m we take x→+0 so that xm is defined.
TheoremThe order is unique, and adds under multiplication
Let ϕ∼lxm and ψ∼l′xn as x→+0, with l,l′=0. Then:
ϕ(x)/xp→0 for every p<m and ∣ϕ(x)/xp∣→∞ for every p>m; so ϕ has only one order.
ϕψ∼ll′xm+n: the orders add.
If m<n then ϕ+ψ∼lxm: the smaller order wins. If m=n and l+l′=0 then ϕ+ψ∼(l+l′)xm.
When m=n and l+l′=0 the leading terms cancel and the sum is of higher order, or has no order at all: tanx∼x and sinx∼x, yet tanx−sinx∼21x3.
Proofs
ProofThe order is unique, and adds under multiplication
Strategy
Every statement comes from writing the ratio in question as a product or sum of ratios whose limits we know, and using the algebra of limits from the last lesson.
Below the order: the ratio tends to 0
For p<m, xpϕ(x)=xmϕ(x)⋅xm−p. The first factor tends to l, the second to 0 (a positive power of x), so the product tends to l⋅0=0.
Above the order: the ratio tends to ∞
For p>m, xpϕ(x)=xmϕ(x)⋅xp−m1. Near 0 the first factor exceeds 21∣l∣>0, and the second tends to +∞. So the product tends to +∞. In particular no p=m gives a finite non-zero limit.
Products
xm+nϕψ=xmϕ⋅xnψ→ll′=0.
Sums
xmϕ+ψ=xmϕ+xnψxn−m. If n>m the last term tends to l′⋅0, so the sum tends to l. If n=m it tends to l+l′, which is a valid order-m limit only when l+l′=0.
∎
Worked examples and exercises
ExerciseThree equivalences●○○Hardy: §98
Show that, as x→0, sinαx∼αx (for α=0), 1−cosx∼21x2 and cosecx−cotx∼21x. What are the orders of smallness?
Hint
All three reduce to (sint)/t→1. For the last, write cosecx−cotx=(1−cosx)/sinx.
Solution
First.(sinαx)/(αx)→1, putting t=αx. Order 1.
Second.(1−cosx)/x2→21 (last lesson). Order 2.
Third.cosecx−cotx=sinx1−cosx=x21−cosx⋅sinxx⋅x. Dividing by x, the ratio tends to 21⋅1=21. Order 1. (In fact cosecx−cotx=tan21x exactly.)
ExerciseCancellation raises the order●●○Hardy: §98
Show that tanx−sinx is of the third order of smallness as x→0, with (tanx−sinx)/x3→21.
Hint
Factor: tanx−sinx=tanx(1−cosx).
Solution
tanx−sinx=sinx(cosx1−1)=tanx(1−cosx). Hence
x3tanx−sinx=xsinx⋅cosx1⋅x21−cosx→1⋅1⋅21=21,
using cosx→1, which follows from 1−cosx=2sin221x<21x2. The two terms are each of order 1, but their leading parts x and x cancel.
ExerciseBounded ratio, but no order●●○Hardy: §98, footnote
Show that xsin(1/x) is O(x) as x→0 but is not of any order of smallness. Hardy remarks that a wider definition (“A∣x∣m≤∣ϕ(x)∣≤B∣x∣m for positive constants A, B”) is sometimes used. Does x{2+sin(1/x)} have order 1 in the wider sense? In Hardy’s sense?
Hint
For m=1 the ratio is sin(1/x). For other m, use part 1 of the theorem’s proof idea: multiply by a power of x.
Solution
∣xsin(1/x)∣≤∣x∣, so it is O(x) with K=2, say. At m=1 the ratio sin(1/x) oscillates between −1 and 1, so it has no limit. For m<1 the ratio x1−msin(1/x)→0; for m>1 it is sin(1/x)/xm−1, which is 0 at x=1/(kπ) and huge at x=1/(2kπ+21π), so it has no limit either. No m gives a non-zero limit.
For ϕ=x{2+sin(1/x)}: ∣x∣≤∣ϕ(x)∣≤3∣x∣, so it has order 1 in the wider sense. But ϕ(x)/x=2+sin(1/x) oscillates between 1 and 3, so it is not of order 1 in the sense of the text, and (as above) of no other order.
Exercise●●○Hardy: Misc. Examples V, 6
Show that, as x→∞,
x+a=x+21ax−1/2(1+η),
where η is of the first order of smallness (for a=0).
Hint
x+a−x=a/{x+a+x}. Solve for η.
Hint
You should find xη→−41a.
Solution
The identity defines η: 1+η=a2x(x+a−x)=x+a+x2x=1+s2, where s=1+a/x. So
η=1+s1−s=(1+s)21−s2=(1+s)2−a/x.
As x→∞, s→1, so xη=−a/(1+s)2→−41a=0. By the definition for x→∞, η is of the first order of smallness.
Check yourself
Check yourselfChoose one
Which is true?
Why
O, o and ∼ only make sense relative to a limit of x. Near 0, x2/x=x→0; near ∞, x/x2=1/x→0. Small powers are big near ∞ and small near 0.
Check yourselfEnter a number
What is the order of smallness of (1−cosx)2 as x→0?
Why
1−cosx is of order 2, and orders add under multiplication: (1−cosx)2∼41x4, of order 4.
Check yourselfTrue or false?
If ϕ and ψ are both of the first order of smallness as x→0, then so is ϕ−ψ.
Why
False. The leading terms can cancel: tanx and sinx are both ∼x, but tanx−sinx∼21x3. The theorem only guarantees order m for the sum when l+l′=0.
Check yourselfChoose one
As x→∞, f(x)=x(2+sinx). Which is correct?
Why
x≤f(x)≤3x, so f=O(x). But f(x)/x=2+sinx oscillates between 1 and 3, so it has no limit: there is no l with f∼lx, and f has no order of greatness in Hardy’s sense. O only bounds; ∼ needs a limit.
Hardy’s language
Summary
Summary
f=O(ϕ): ∣f∣ is at most a constant times ϕ; f=o(ϕ): f/ϕ→0; f∼lϕ: f/ϕ→l=0. Each is relative to a stated limit of x.
ϕ has order of smallness m at 0 when ϕ(x)/xm tends to a finite non-zero limit; the order, if it exists, is unique.
Orders add under products; under sums the smaller order wins, unless the leading terms cancel.
Standard facts: sinx∼x, 1−cosx∼21x2, tanx−sinx∼21x3, cosecx−cotx∼21x.
The scale of powers is incomplete: some functions have fractional order, some (like xsin(1/x)) have none.