Chapter X · The general theory of the logarithmic, exponential and circular functions

The exponential limit

§246 30 min

(1 + z/n)ⁿ → exp z for complex z, from the logarithmic series; and the derivatives of log(1 + tz), exp φ(t) and (1 + tz)ᵐ needed for the binomial theorem.

Why this matters

For real xx Hardy proved (1+x/n)n→ex(1 + x/n)^n \to e^x (§215), the limit behind compound interest. §246 extends it to complex zz, with a proof that runs entirely through the logarithmic series of the last lesson. Along the way it collects three differentiation rules for complex functions of a real variable tt, which are exactly what the general binomial theorem (§247) needs.

The idea

(1+z/n)n(1 + z/n)^n is the product of nn equal factors 1+z/n1 + z/n. Multiplying by 1+z/n1 + z/n turns a point through the small angle am⁡(1+z/n)≈Im⁡z/n\operatorname{am}(1 + z/n) \approx \operatorname{Im}z/n and stretches it by ∣1+z/n∣≈1+Re⁡z/n|1 + z/n| \approx 1 + \operatorname{Re}z/n. So the points 1,(1+z/n),(1+z/n)2,…,(1+z/n)n1, (1 + z/n), (1 + z/n)^2, \dots, (1 + z/n)^n form a polygon that turns and grows in nn equal small steps, through a total angle of about Im⁡z\operatorname{Im}z and a total stretch of about eRe⁡ze^{\operatorname{Re}z}. That is what exp⁡z\exp z does: it turns 11 through Im⁡z\operatorname{Im}z and stretches it by eRe⁡ze^{\operatorname{Re}z}.

Explore (1 + z/n)ⁿ as a polygon

Try this. With z=πiz = \pi i, increase nn from 11 to 200200 and watch the end of the polygon. Then drag zz elsewhere, for example to 1+3i1 + 3i and to −2+2i-2 + 2i.

(1+zn)n→exp⁡z\left(1 + \frac{z}{n}\right)^{n} \to \exp z
ReIm
  • z (drag it)
  • the points (1 + z/n)ᵏ, k = 0 … n
  • the curve exp(tz), 0 ≤ t ≤ 1, ending at exp z
z=3.14iz = 3.14i. Each step multiplies by 1+z/n=1+0.7854i1 + z/n = 1 + 0.7854i: a turn through 0.6660.666 radians and a stretch by 1.2721.272. (1+z/n)n=−2.3206+1.2037i(1 + z/n)^n = -2.3206 + 1.2037i, exp⁡z=−1\exp z = -1; distance 1.791.79.
What to notice

For z=πiz = \pi i and n=1n = 1 the single step lands at 1+πi1 + \pi i, far from the answer; as nn grows the polygon hugs the dashed half-circle more and more closely and its end approaches exp⁡(πi)=−1\exp(\pi i) = -1. Each step is a slightly-more-than-unit stretch: ∣1+πi/n∣n=(1+π2/n2)n/2|1 + \pi i/n|^n = (1 + \pi^2/n^2)^{n/2}, which tends to 11. The error shrinks roughly like 1/n1/n: doubling nn halves the distance.

Precise statements

Throughout, hh and tt are real, and logarithms and powers have their principal values.

Theorem The basic limit Hardy: §246 (1)

For every complex zz, lim⁡h→0log⁡(1+hz)h=z\displaystyle\lim_{h \to 0}\frac{\log(1 + hz)}{h} = z.

Theorem The exponential limit Hardy: §246 (2)

For every complex zz,

lim⁡n→∞(1+zn)n=exp⁡z.\lim_{n \to \infty}\Bigl(1 + \frac{z}{n}\Bigr)^n = \exp z.
Theorem Three derivatives Hardy: §246 (3), (4)

Let zz and mm be complex, and tt real with ∣tz∣<1|tz| < 1. Then

ddtlog⁡(1+tz)=z1+tz,ddt(1+tz)m=mz(1+tz)m−1.\frac{d}{dt}\log(1 + tz) = \frac{z}{1 + tz}, \qquad \frac{d}{dt}(1 + tz)^m = mz(1 + tz)^{m-1}.

More generally, if ϕ(t)=ψ(t)+iχ(t)\phi(t) = \psi(t) + i\chi(t) with ψ\psi, χ\chi differentiable, then ddtexp⁡ϕ(t)=ϕ′(t)exp⁡ϕ(t)\dfrac{d}{dt}\exp\phi(t) = \phi'(t)\exp\phi(t).

Proofs

Proof The basic limit
Strategy

Expand log⁡(1+hz)\log(1 + hz) by the logarithmic series (valid once ∣hz∣<1|hz| < 1), divide by hh, and bound everything after the first term by a geometric series.

Expand

For ∣hz∣<1|hz| < 1, log⁡(1+hz)=hz−12(hz)2+13(hz)3−⋯\log(1 + hz) = hz - \tfrac12(hz)^2 + \tfrac13(hz)^3 - \cdots (§244). So log⁡(1+hz)h=z+ϕ(h,z)\dfrac{\log(1 + hz)}{h} = z + \phi(h, z) with ϕ(h,z)=−12hz2+13h2z3−⋯\phi(h, z) = -\tfrac12 hz^2 + \tfrac13 h^2 z^3 - \cdots.

Bound the rest

∣ϕ(h,z)∣≤∣hz2∣{1+∣hz∣+∣hz∣2+⋯ }=∣hz2∣1−∣hz∣|\phi(h, z)| \le |hz^2|\{1 + |hz| + |hz|^2 + \cdots\} = \dfrac{|hz^2|}{1 - |hz|}, using 1k≤1\tfrac1k \le 1 for each coefficient.

Let h→0h \to 0

The bound tends to 00, so log⁡(1+hz)/h→z\log(1 + hz)/h \to z.

Proof The exponential limit
Strategy

Take h=1/nh = 1/n in the basic limit: nlog⁡(1+z/n)→zn\log(1 + z/n) \to z. Then apply exp⁡\exp, which is continuous, and note that exp⁡{nlog⁡(1+z/n)}\exp\{n\log(1 + z/n)\} is exactly (1+z/n)n(1 + z/n)^n.

The exponent

By the basic limit with h=1/nh = 1/n: wn=nlog⁡(1+z/n)→zw_n = n\log(1 + z/n) \to z.

Rewrite the power

exp⁡wn={exp⁡log⁡(1+z/n)}n=(1+z/n)n\exp w_n = \{\exp\log(1 + z/n)\}^n = (1 + z/n)^n, by the addition theorem (exp⁡nw=(exp⁡w)n\exp n w = (\exp w)^n) and because exp⁡\exp of any logarithm of a number is that number.

Continuity of exp

∣exp⁡wn−exp⁡z∣=∣exp⁡z∣ ∣exp⁡(wn−z)−1∣≤∣exp⁡z∣ ∣wn−z∣ e∣wn−z∣|\exp w_n - \exp z| = |\exp z|\,|\exp(w_n - z) - 1| \le |\exp z|\,|w_n - z|\,e^{|w_n - z|}, by the inequality ∣exp⁡u−1∣≤∣u∣e∣u∣|\exp u - 1| \le |u|e^{|u|} (lesson on the exponential series). Since wn−z→0w_n - z \to 0, the right side tends to 00.

Proof Three derivatives
Strategy

For log⁡(1+tz)\log(1 + tz): a difference quotient reduces to the basic limit. For exp⁡ϕ\exp\phi: write exp⁡ϕ=eψ(cos⁡χ+isin⁡χ)\exp\phi = e^\psi(\cos\chi + i\sin\chi) and differentiate the real and imaginary parts. For the power: combine the two with (1+tz)m=exp⁡{mlog⁡(1+tz)}(1 + tz)^m = \exp\{m\log(1 + tz)\}.

Derivative of log⁡(1+tz)\log(1 + tz)

For small real hh, log⁡(1+tz+hz)−log⁡(1+tz)=log⁡(1+hz1+tz)\log(1 + tz + hz) - \log(1 + tz) = \log\Bigl(1 + \dfrac{hz}{1 + tz}\Bigr). This uses the product rule for principal logarithms, which holds here because 1+tz1 + tz and 1+hz/(1+tz)1 + hz/(1 + tz) both lie in the right half-plane (when ∣tz∣<1|tz| < 1 and hh is small), so their principal amplitudes add to something in (−π,π)(-\pi, \pi). Dividing by hh and applying the basic limit with z/(1+tz)z/(1 + tz) in place of zz gives z/(1+tz)z/(1 + tz).

Derivative of exp⁡ϕ\exp\phi

exp⁡ϕ=eψcos⁡χ+ieψsin⁡χ\exp\phi = e^\psi\cos\chi + ie^\psi\sin\chi. Differentiating, (exp⁡ϕ)′=eψ{(cos⁡χ+isin⁡χ)ψ′+(−sin⁡χ+icos⁡χ)χ′}=eψ(cos⁡χ+isin⁡χ)(ψ′+iχ′)=ϕ′exp⁡ϕ(\exp\phi)' = e^\psi\{(\cos\chi + i\sin\chi)\psi' + (-\sin\chi + i\cos\chi)\chi'\} = e^\psi(\cos\chi + i\sin\chi)(\psi' + i\chi') = \phi'\exp\phi.

Derivative of (1+tz)m(1 + tz)^m

With ϕ(t)=mlog⁡(1+tz)\phi(t) = m\log(1 + tz) and the first step, ϕ′(t)=mz/(1+tz)\phi'(t) = mz/(1 + tz), so ddt(1+tz)m=mz1+tzexp⁡{mlog⁡(1+tz)}=mzexp⁡{(m−1)log⁡(1+tz)}=mz(1+tz)m−1\dfrac{d}{dt}(1 + tz)^m = \dfrac{mz}{1 + tz}\exp\{m\log(1 + tz)\} = mz\exp\{(m - 1)\log(1 + tz)\} = mz(1 + tz)^{m-1}, all powers principal. (The middle equality uses exp⁡{mlog⁡w}/w=exp⁡{(m−1)log⁡w}\exp\{m\log w\}/w = \exp\{(m-1)\log w\}, since w=exp⁡log⁡ww = \exp\log w.)

Worked examples and exercises

Exercise Euler's limit directly ●●○ Hardy: §246

Without using the theorem, show that (1+πi/n)n→−1(1 + \pi i/n)^n \to -1 by computing the modulus and amplitude of 1+πi/n1 + \pi i/n.

Hint
∣1+πi/n∣n=(1+π2/n2)n/2|1 + \pi i/n|^n = (1 + \pi^2/n^2)^{n/2}, and am⁡(1+πi/n)=arctan⁡(π/n)\operatorname{am}(1 + \pi i/n) = \arctan(\pi/n).

Solution

By De Moivre, (1+πi/n)n(1 + \pi i/n)^n has modulus (1+π2/n2)n/2(1 + \pi^2/n^2)^{n/2} and amplitude narctan⁡(π/n)n\arctan(\pi/n). For the modulus: log⁡\log of it is n2log⁡(1+π2/n2)\tfrac n2\log(1 + \pi^2/n^2), which lies between 00 and n2⋅π2/n2=π2/(2n)\tfrac n2 \cdot \pi^2/n^2 = \pi^2/(2n), so it tends to 00 and the modulus tends to 11. For the amplitude: arctan⁡u/u→1\arctan u/u \to 1 as u→0u \to 0, so narctan⁡(π/n)=π⋅arctan⁡(π/n)π/n→πn\arctan(\pi/n) = \pi\cdot\dfrac{\arctan(\pi/n)}{\pi/n} \to \pi. Hence the limit is cos⁡π+isin⁡π=−1\cos\pi + i\sin\pi = -1.

Exercise How fast? ●●○ Hardy: §246

Show that nlog⁡(1+z/n)−z=−z22n+O(1/n2)n\log(1 + z/n) - z = -\dfrac{z^2}{2n} + O(1/n^2), and deduce that (1+z/n)n=exp⁡z {1−z22n+O(1/n2)}(1 + z/n)^n = \exp z\,\bigl\{1 - \dfrac{z^2}{2n} + O(1/n^2)\bigr\}. What does this predict for z=πiz = \pi i and n=100n = 100?

Hint
Use the series for log⁡(1+z/n)\log(1 + z/n) and exp⁡u=1+u+O(u2)\exp u = 1 + u + O(u^2).

Solution

nlog⁡(1+z/n)=z−z22n+z33n2−⋯n\log(1 + z/n) = z - \dfrac{z^2}{2n} + \dfrac{z^3}{3n^2} - \cdots, and the tail after −z2/(2n)-z^2/(2n) is at most ∣z∣3n211−∣z∣/n\dfrac{|z|^3}{n^2}\dfrac{1}{1 - |z|/n} in modulus, so it is O(1/n2)O(1/n^2). Then (1+z/n)n=exp⁡z⋅exp⁡(u)(1 + z/n)^n = \exp z \cdot \exp(u) with u=−z2/(2n)+O(1/n2)u = -z^2/(2n) + O(1/n^2), and exp⁡u=1+u+O(u2)=1−z2/(2n)+O(1/n2)\exp u = 1 + u + O(u^2) = 1 - z^2/(2n) + O(1/n^2).

For z=πiz = \pi i: z2=−π2z^2 = -\pi^2, so (1+πi/n)n≈−1⋅(1+π2/(2n))(1 + \pi i/n)^n \approx -1\cdot(1 + \pi^2/(2n)). At n=100n = 100 the error is about π2/200≈0.049\pi^2/200 \approx 0.049, along the real axis (beyond −1-1). The explorer’s read-out agrees: the distance at n=100n = 100 is about 0.050.05.

Exercise A derivative to check ●○○ Hardy: §246 (4)

For z=iz = i and m=12m = \tfrac12, compute ddt(1+it)1/2\dfrac{d}{dt}(1 + it)^{1/2} at t=0t = 0 in two ways: from formula (4), and by differentiating (1+it)1/2=(1+t2)1/4{cos⁡(12arctan⁡t)+isin⁡(12arctan⁡t)}(1 + it)^{1/2} = (1 + t^2)^{1/4}\{\cos(\tfrac12\arctan t) + i\sin(\tfrac12\arctan t)\}.

Hint
At t=0t = 0 the principal value of (1+it)−1/2(1 + it)^{-1/2} is 11.

Solution

Formula (4): mz(1+tz)m−1=12i⋅1=12imz(1 + tz)^{m-1} = \tfrac12 i \cdot 1 = \tfrac12 i at t=0t = 0.

Directly: the modulus (1+t2)1/4(1 + t^2)^{1/4} has derivative 12t(1+t2)−3/4=0\tfrac12 t(1 + t^2)^{-3/4} = 0 at t=0t = 0; the amplitude 12arctan⁡t\tfrac12\arctan t has derivative 12\tfrac12 at t=0t = 0. At t=0t = 0 the point is 11, moving with velocity (radial 0)+i⋅1⋅12=12i(\text{radial } 0) + i\cdot 1 \cdot \tfrac12 = \tfrac12 i. ✓

Exercise exp is the limit along any route ●●○ Hardy: §246

Show that (1+z/x)x→exp⁡z(1 + z/x)^x \to \exp z as x→∞x \to \infty through real values, where the power has its principal value.

Hint
Put h=1/xh = 1/x in the basic limit; for real xx the power is exp⁡{xlog⁡(1+z/x)}\exp\{x\log(1 + z/x)\} by definition.

Solution

By definition (§236) the principal value of (1+z/x)x(1 + z/x)^x is exp⁡{xlog⁡(1+z/x)}\exp\{x\log(1 + z/x)\}. With h=1/xh = 1/x, the basic limit gives xlog⁡(1+z/x)→zx\log(1 + z/x) \to z as x→∞x \to \infty, and continuity of exp⁡\exp (as in the proof) gives the result. Only the principal value is claimed: for non-integer xx the other values of the power are exp⁡{xlog⁡(1+z/x)+2kπix}\exp\{x\log(1 + z/x) + 2k\pi i x\}, which do not converge.

Check yourself

Check yourself Choose one

In the polygon 1,(1+z/n),(1+z/n)2,…1, (1 + z/n), (1 + z/n)^2, \dots, what does each step do?

Why

Consecutive points are successive powers, so each is the previous one times 1+z/n1 + z/n. Adding z/nz/n would produce a straight line from 11 to 1+z1 + z. Adding the terms zk/k!z^k/k! is the different polygon of the exponential series (lesson on §242); both polygons end near exp⁡z\exp z, but by different routes.

Check yourself Enter a number

What is lim⁡n→∞∣1+πi/n∣n\lim_{n\to\infty}|1 + \pi i/n|^n?

Why

∣1+πi/n∣n=(1+π2/n2)n/2|1 + \pi i/n|^n = (1 + \pi^2/n^2)^{n/2}, whose logarithm is at most π2/(2n)→0\pi^2/(2n) \to 0. So the limit is 1=∣exp⁡πi∣1 = |\exp\pi i|.

Check yourself True or false?

If ϕ(t)\phi(t) is a differentiable complex function of the real variable tt, then ddtexp⁡ϕ(t)=ϕ′(t)exp⁡ϕ(t)\dfrac{d}{dt}\exp\phi(t) = \phi'(t)\exp\phi(t), exactly as for real ϕ\phi.

Why

True; the proof writes exp⁡ϕ=eψ(cos⁡χ+isin⁡χ)\exp\phi = e^\psi(\cos\chi + i\sin\chi) and differentiates. The chain rule for exp⁡\exp has the same form for complex-valued functions of a real variable.

Hardy’s language

Summary

Summary
  • log⁡(1+hz)/h→z\log(1 + hz)/h \to z as real h→0h \to 0, from the logarithmic series with remainder at most ∣hz2∣/(1−∣hz∣)|hz^2|/(1 - |hz|).
  • (1+z/n)n=exp⁡{nlog⁡(1+z/n)}→exp⁡z(1 + z/n)^n = \exp\{n\log(1 + z/n)\} \to \exp z for every complex zz; the error is about ∣z2exp⁡z∣/(2n)|z^2\exp z|/(2n).
  • Geometrically: nn equal small turns and stretches add up to a turn through Im⁡z\operatorname{Im}z and a stretch by eRe⁡ze^{\operatorname{Re}z}.
  • ddtexp⁡ϕ=ϕ′exp⁡ϕ\frac{d}{dt}\exp\phi = \phi'\exp\phi and ddt(1+tz)m=mz(1+tz)m−1\frac{d}{dt}(1 + tz)^m = mz(1 + tz)^{m-1} (principal values, ∣tz∣<1|tz| < 1).