Real Analysis
Real analysis makes precise the two operations on which the whole of physics rests: the limit, from which continuity and the derivative follow, and the integral, which undoes the derivative and sums continuous distributions. Everything in this chapter descends from a single property of the real numbers — completeness — which is therefore stated first, as an axiom here and as a theorem in Appendix A.7, where the real numbers are constructed and the property is proven. It is, by design, the deepest proof of Parts I and II.
The real numbers
The rational numbers \(\Q\) form an ordered field (Algebraic Structures), but a gapped one: no rational squares to \(2\). Analysis begins by filling the gaps.
\(\R\) is an ordered field containing \(\Q\), in which every nonempty subset \(S\) that is bounded above has a least upper bound \(\sup S \in \R\).
Full derivation: Appendix A.7 (p. 2809) constructs \(\R\) from \(\Q\) by Dedekind cuts and proves Axiom 7.1 as a theorem, together with three consequences used constantly below: the Archimedean property (Corollary A.45: for \(x > 0\) and any \(y\) some \(n x > y\)), the density of \(\Q\) (between any two reals lies a rational), and monotone convergence (Corollary A.46: a bounded nondecreasing sequence converges to its supremum). By symmetry, bounded nonempty sets have infima and bounded nonincreasing sequences converge to them.
For \(x \in \R\), \(\abs{x} = x\) if \(x \ge 0\) and \(\abs{x} = -x\) otherwise.
\(\abs{x + y} \le \abs{x} + \abs{y}\) for all \(x, y \in \R\). Rests on Definition 7.2.
Derives Proposition 7.3. From \(-\abs{x} \le x \le \abs{x}\) and the same for \(y\), adding gives \(-(\abs{x}+\abs{y}) \le x + y \le \abs{x} + \abs{y}\), which is the claim.
∎Sequences
A sequence \((a_n)_{n\in\N}\) in \(\R\) converges to \(L \in \R\), written \(a_n \longrightarrow L\) or \(\lim_{n\to\infty} a_n = L\), iff
Rests on Definition 7.2.
A sequence has at most one limit. Rests on Definition 7.4 and Proposition 7.3.
Derives Proposition 7.5. If \(a_n \to L\) and \(a_n \to L'\) with \(L \neq L'\), take \(\varepsilon = \abs{L - L'}/2 > 0\). For \(n\) beyond both thresholds, \(\abs{L - L'} \le \abs{L - a_n} + \abs{a_n - L'} < 2\varepsilon = \abs{L - L'}\), a contradiction.
∎If \(a_n \to A\) and \(b_n \to B\), then \(a_n + b_n \to A + B\), \(a_n b_n \to AB\), and, if \(B \neq 0\), \(a_n/b_n \to A/B\). Rests on Definition 7.4 and Proposition 7.3.
Derives Proposition 7.6. Sum: given \(\varepsilon\), beyond the larger of the two thresholds for \(\varepsilon/2\), \(\abs{(a_n + b_n) - (A + B)} \le \abs{a_n - A} + \abs{b_n - B} < \varepsilon\). Product: convergent sequences are bounded (beyond \(N_1\) for \(\varepsilon = 1\) all terms lie within \(1\) of the limit, and finitely many remain), say \(\abs{a_n} \le M\); then
and each term is made smaller than \(\varepsilon/2\) beyond a suitable threshold. Quotient: it suffices to prove \(1/b_n \to 1/B\). Beyond some \(N_0\), \(\abs{b_n} > \abs{B}/2\) (take \(\varepsilon = \abs{B}/2\)); then \(\abs{1/b_n - 1/B} = \abs{B - b_n}/(\abs{b_n}\abs{B}) \le 2\abs{b_n - B}/\abs{B}^2\), which is controlled as before.
∎Every bounded sequence in \(\R\) has a convergent subsequence. Rests on Corollaries A.45 and A.46.
Derives Theorem 7.7. Let \(a_n \in [A_0, B_0]\) for all \(n\). Bisect the interval: at least one half contains \(a_n\) for infinitely many indices \(n\); call it \([A_1, B_1]\) and pick \(n_1\) with \(a_{n_1} \in [A_1, B_1]\). Iterating, we obtain nested intervals \([A_k, B_k]\) of length \((B_0 - A_0)/2^k\), each containing infinitely many terms, and indices \(n_1 < n_2 < \cdots\) with \(a_{n_k} \in [A_k, B_k]\). The sequence \((A_k)\) is nondecreasing and bounded above by \(B_0\), so by monotone convergence (Corollary A.46) \(A_k \to L\); since \(0 \le B_k - A_k = (B_0 - A_0)/2^k \to 0\) (Archimedean property), \(B_k \to L\) as well, and \(A_k \le a_{n_k} \le B_k\) squeezes \(a_{n_k} \to L\).
∎A sequence in \(\R\) converges if and only if it is a Cauchy sequence: \(\forall\,\varepsilon > 0\ \exists\,N \mid m, n \ge N \implies \abs{a_m - a_n} < \varepsilon\). Rests on Definition 7.4 and Corollary A.47.
Derives Theorem 7.8. Necessity: if \(a_n \to L\), then beyond the threshold for \(\varepsilon/2\), \(\abs{a_m - a_n} \le \abs{a_m - L} + \abs{L - a_n} < \varepsilon\). Sufficiency is Corollary A.47, proven in Appendix A.7 from monotone convergence.
∎The Cauchy criterion is the working form of completeness: it certifies convergence without knowing the limit, which is how every series and every integral below will be shown to exist.
Real functions
A real function is a map \(f : A \subseteq \R \longrightarrow \R\) (Logic, Sets, and Maps); \(A\) is its domain and \(f(A) = \set{f(x) \mid x \in A}\) its image. Rests on Definition 3.43.
Consider a real number \(C\in\R\). We define the constant function as
Rests on Definition 7.9.
Consider two real functions \(f\) and \(g\). We define the sum of functions as the function
Rests on Definition 7.9.
Consider two real functions \(f\) and \(g\). We define the product of functions as the function
Rests on Definition 7.9.
Consider two real functions \(f\) and \(g\). We define the composition of \(f\) with \(g\) as the function
Rests on Definition 7.9.
Consider a bijective real function \(f : A \longrightarrow B\), \(x \longmapsto f(x) = y\). The inverse function \(f^{-1} : B \longrightarrow A\) assigns to each \(y \in B\) the unique \(x \in A\) with \(f(x) = y\), so that \(f^{-1} \circ f = \id_A\) and \(f \circ f^{-1} = \id_B\). A strictly monotonic function is injective, and is therefore invertible onto its image. Rests on Definitions 3.47 and 7.13.
\(\abs{\,\cdot\,} : \R \longrightarrow \R\), \(x \longmapsto \abs{x}\), with \(\abs{x}\) as in Definition 7.2. Rests on Definitions 7.2 and 7.9.
Limits
Consider a real function \(f:x\longmapsto f(x)\). We say that the limit of \(f\), as \(x\) tends to \(x_0\), exists and equals \(L\) if and only if
If it exists, we denote this limit by
Note that the definition requires
that is, the point \(x_0\) itself is excluded: the limit probes the values of \(f\) near \(x_0\), never at \(x_0\). Rests on Definition 7.16.
The algebra of limits of sequences (Proposition 7.6) transfers verbatim to limits of functions, by the same \(\varepsilon\)–\(\delta\) estimates; we use it freely.
One-sided limits
Consider a real function \(f:(a,b)\longrightarrow B\subseteq\R\). From the definition of the limit we have the condition
-
If we choose \(x_0=a\), then, since the interval is open,
\[ x>a\quad\implies\quad 0<x-a<\delta\ep \]We say that the limit of \(f\) from the right, as \(x\) tends to \(a\), is \(L\) if and only if
\begin{equation}\tag{7.5} \lim_{x\longrightarrow a}f(x)=L,\quad x>a\ec \end{equation}which we denote by
\begin{equation}\tag{7.6} \lim_{x\longrightarrow a^{+}}f(x)=L\ep \end{equation} -
If we choose \(x_0=b\), then, since the interval is open,
\begin{align*} x<b &\implies 0<-(x-b)<\delta\\ &\iff 0>x-b>-\delta\\ &\iff -\delta<x-b<0\ep \end{align*}We say that the limit of \(f\) from the left, as \(x\) tends to \(b\), is \(L\) if and only if
\begin{equation}\tag{7.7} \lim_{x\longrightarrow b}f(x)=L,\quad x<b\ec \end{equation}which we denote by
\begin{equation}\tag{7.8} \lim_{x\longrightarrow b^{-}}f(x)=L\ep \end{equation}
Let \(x_0\) be interior to the domain of \(f\). Then \(\lim_{x\to x_0} f(x) = L\) if and only if both one-sided limits exist and
Rests on Definition 7.16, Equation (7.7) and Equation (7.5).
Derives Proposition 7.18. (\(\Rightarrow\)) The two-sided \(\delta\) works for each side separately. (\(\Leftarrow\)) Given \(\varepsilon\), let \(\delta_{-}\) and \(\delta_{+}\) be the one-sided thresholds and \(\delta = \min(\delta_-, \delta_+)\). Any \(x\) with \(0 < \abs{x - x_0} < \delta\) lies on one of the two sides and satisfies the corresponding estimate, so \(\abs{f(x) - L} < \varepsilon\).
∎Infinite limits and limits at infinity
\(\lim_{x\to a} f(x) = \infty\) iff for every \(M \in \R\) there is \(\delta > 0\) with \(0 < \abs{x - a} < \delta \implies f(x) > M\); and \(L = \lim_{x\to\infty} f(x)\) iff for every \(\varepsilon > 0\) there is \(R \in \R\) with \(x > R \implies \abs{f(x) - L} < \varepsilon\). The variants with \(-\infty\) are defined by the obvious sign changes. Rests on Definitions 7.2 and 7.16.
An asymptote of \(f\) is a line approached by its graph in one of these senses: vertical at \(a\) when \(\lim_{x \to a^{\pm}} f(x) = \pm\infty\), horizontal at height \(L\) when \(\lim_{x \to \pm\infty} f(x) = L\), and oblique \(y = mx + c\) when \(\lim_{x\to\pm\infty}\left[f(x)-mx-c\right] = 0\).
Continuity
Consider a function \(f:A\subseteq\R\longrightarrow B\subseteq\R\) and a point \(x_0\in A\). We say that \(f\) is continuous at \(x_0\) if and only if
\(f\) is continuous on \(A\) iff it is continuous at every point of \(A\); the set of such functions is denoted \(C^{0}(A)\). It is piecewise continuous on \([a,b]\) iff it is continuous there except at finitely many points, at each of which both one-sided limits exist. Rests on Definition 7.16, Equation (7.7) and Equation (7.5).
Two ways of failing this condition are distinguished:
-
if the limit exists but differs from \(f(x_0)\), we say that \(f\) has a removable discontinuity at \(x_0\);
-
if the limit does not exist, we say that \(f\) has an essential discontinuity at \(x_0\).
\(f\) is continuous at \(x_0\) if and only if for every sequence \(x_n \longrightarrow x_0\) in its domain, \(f(x_n) \longrightarrow f(x_0)\). Rests on Definitions 7.4 and 7.20.
Derives Proposition 7.22. (\(\Rightarrow\)) Given \(\varepsilon\), choose \(\delta\) from continuity, then \(N\) so that \(n \ge N \implies \abs{x_n - x_0} < \delta\); then \(\abs{f(x_n) - f(x_0)} < \varepsilon\). (\(\Leftarrow\)) If \(f\) is not continuous at \(x_0\), some \(\varepsilon_0\) admits no \(\delta\): for each \(n\) there is \(x_n\) with \(\abs{x_n - x_0} < 1/n\) but \(\abs{f(x_n) - f(x_0)} \ge \varepsilon_0\). Then \(x_n \to x_0\) while \(f(x_n) \not\to f(x_0)\).
∎Sums, products, quotients (where defined) and compositions of continuous functions are continuous, by Proposition 7.22 and Proposition 7.6.
Let \(f \in C^{0}([a,b])\) with \(f(a) < 0 < f(b)\). Then there is \(c \in (a,b)\) with \(f(c) = 0\). Rests on Axiom 7.1 and Definition 7.20.
Derives Theorem 7.23. Let \(S = \set{x \in [a,b] \mid f(x) < 0}\); \(S\) is nonempty (\(a \in S\)) and bounded above by \(b\), so \(c = \sup S\) exists (Axiom 7.1). We claim \(f(c) = 0\). If \(f(c) < 0\), then \(c < b\), and continuity provides \(\delta > 0\) with \(f < 0\) on \((c - \delta, c + \delta) \cap [a,b]\) (take \(\varepsilon = -f(c)\)); points just above \(c\) would then lie in \(S\), contradicting that \(c\) bounds \(S\). If \(f(c) > 0\), continuity gives \(f > 0\) on \((c - \delta, c]\) for some \(\delta > 0\); then \(c - \delta\) is already an upper bound of \(S\), contradicting leastness. Hence \(f(c) = 0\), and \(c \neq a, b\) because \(f(a) < 0 < f(b)\).
∎A continuous function on a closed bounded interval \([a,b]\) is bounded and attains its supremum and infimum. Rests on Axiom 7.1, Theorem 7.7 and Proposition 7.22.
Derives Theorem 7.24. Bounded: if not, pick \(x_n \in [a,b]\) with \(\abs{f(x_n)} > n\). By Bolzano–Weierstrass (Theorem 7.7) a subsequence \(x_{n_k} \to c \in [a,b]\); continuity forces \(f(x_{n_k}) \to f(c)\), but \(\abs{f(x_{n_k})} > n_k \to \infty\) — contradiction. Attained: let \(M = \sup f([a,b])\), which now exists; pick \(x_n\) with \(f(x_n) > M - 1/n\). A convergent subsequence \(x_{n_k} \to c\) gives \(f(c) = \lim f(x_{n_k}) = M\). The infimum is the supremum of \(-f\).
∎A continuous function on \([a,b]\) is uniformly continuous: for every \(\varepsilon > 0\) there is a single \(\delta > 0\) such that \(\abs{x - y} < \delta \implies \abs{f(x) - f(y)} < \varepsilon\) for all \(x, y \in [a,b]\). Rests on Theorem 7.7 and Proposition 7.22.
Derives Theorem 7.25. If not, some \(\varepsilon_0\) admits points \(x_n, y_n\) with \(\abs{x_n - y_n} < 1/n\) but \(\abs{f(x_n) - f(y_n)} \ge \varepsilon_0\). Extract \(x_{n_k} \to c\) (Theorem 7.7); then \(y_{n_k} \to c\) too, and continuity gives \(f(x_{n_k}) - f(y_{n_k}) \to f(c) - f(c) = 0\), contradicting \(\abs{f(x_{n_k}) - f(y_{n_k})} \ge \varepsilon_0\).
∎The derivative
Consider a real function
and a point \(x_0\in(a,b)\). We define the derivative of \(f\) at \(x_0\) as the real number given by
We may introduce
in terms of which the derivative reads
If \(f'(x_0)\) exists, \(f\) is continuous at \(x_0\). Rests on Definition 7.26, Definition 7.20 and Proposition 7.6.
Derives Proposition 7.27. \(f(x) - f(x_0) = \dfrac{f(x)-f(x_0)}{x-x_0}\,(x - x_0) \longrightarrow f'(x_0)\cdot 0 = 0\) as \(x \to x_0\), by the algebra of limits.
∎Geometric interpretation of the derivative
The construction underlying Equation (7.11) is geometric: the difference quotient is the slope of the secant line through the points \((x_0,f(x_0))\) and \((x,f(x))\) of the graph, and the derivative is the slope of the tangent line obtained in the limit \(x\longrightarrow x_0\), as the sequence of figures Figures 7.1 to 7.4 illustrates. It is for this reason that we must take only open intervals: the limit must be able to approach the point from within the domain.
The secant-to-tangent construction of the derivative (panel 1 of 4).
The secant-to-tangent construction of the derivative (panel 2 of 4).
The secant-to-tangent construction of the derivative (panel 3 of 4).
The secant-to-tangent construction of the derivative (panel 4 of 4).
The derivative function
From the definition in Equation (7.11) we may take \(x_0=u\) to be an arbitrary point of the interval \((a,b)\) at which the derivative is evaluated, and thereby obtain a general expression for the derivative at any point of \((a,b)\). We define the derivative function of \(f\) as the real function that assigns to each point of the domain of \(f\) the derivative of \(f\) at that point, which we denote by \(f'\). Making the change of variable \(h=x-u\),
Rules of differentiation
Let \(f:x\longmapsto C\) be a constant real function. Then
Rests on Definition 7.10 and Equation (7.14).
Derivation. Derives Proposition 7.28. From Equation (7.14) we have
\((\lambda f)' = \lambda f'\) and \((f + g)' = f' + g'\) for \(\lambda \in \R\). Rests on Definition 7.11, Equation (7.14) and Proposition 7.6.
Derives Proposition 7.29. Both difference quotients split termwise, and the algebra of limits (Proposition 7.6) distributes the limit over the pieces.
∎Let \(f\) and \(g\) be real functions. Then
Rests on Definition 7.12, Equation (7.14), Proposition 7.27 and Proposition 7.6.
Derivation. Derives Proposition 7.30. We have
where the last step uses Equation (7.14) and the continuity of \(g\) (Proposition 7.27).
∎Let \(f\) be differentiable at \(x\) and \(g\) differentiable at \(f(x)\). Then
Rests on Definition 7.13, Proposition 7.27 and Proposition 7.6.
Derivation. Derives Proposition 7.31. Define, for \(y\) in the domain of \(g\) and \(u_0 = f(x)\),
Differentiability of \(g\) at \(u_0\) says precisely that \(\varphi\) is continuous at \(u_0\), and by construction \(g(y) - g(u_0) = \varphi(y)\,(y - u_0)\) for all \(y\) — including \(y = u_0\), which is the case the naive quotient argument cannot handle. Substituting \(y = f(x + h)\),
As \(h \to 0\): \(f(x+h) \to f(x)\) by Proposition 7.27, so \(\varphi(f(x+h)) \to \varphi(f(x)) = g'(f(x))\) by continuity of \(\varphi\), while the second factor tends to \(f'(x)\). The algebra of limits gives Equation (7.17).
∎Let \(f\) be strictly monotonic and continuous on an interval, and differentiable at \(x_0\) with \(f'(x_0) \neq 0\). Then \(f^{-1}\) is differentiable at \(y_0 = f(x_0)\) and
Rests on Definition 7.14, Theorem 7.23 and Proposition 7.6.
Derives Proposition 7.32. For \(y \neq y_0\) write \(x = f^{-1}(y)\); continuity and strict monotonicity make \(f^{-1}\) continuous (its one-sided limits exist by monotonicity and cannot jump without leaving a gap in the image, forbidden by Theorem 7.23), so \(y \to y_0\) forces \(x \to x_0\). Then
The mean value theorems
If \(f\) attains a local maximum or minimum at an interior point \(c\) and \(f'(c)\) exists, then \(f'(c) = 0\). Rests on Definition 7.26 and Proposition 7.18.
Derives Lemma 7.33. Say the extremum is a maximum. For \(h > 0\) small, \(\left[f(c+h)-f(c)\right]/h \le 0\), so the right limit gives \(f'(c) \le 0\); for \(h < 0\), the quotient is \(\ge 0\), so \(f'(c) \ge 0\). Hence \(f'(c) = 0\).
∎If \(f \in C^{0}([a,b])\) is differentiable on \((a,b)\) and \(f(a) = f(b)\), then \(f'(c) = 0\) for some \(c \in (a,b)\). Rests on Theorem 7.24 and Lemma 7.33.
Derives Theorem 7.34. By the extreme value theorem (Theorem 7.24) \(f\) attains a maximum and a minimum on \([a,b]\). If both are attained at the endpoints, \(f\) is constant (max \(=\) min) and any interior \(c\) works. Otherwise one extremum is interior, and Lemma 7.33 finishes.
∎If \(f \in C^{0}([a,b])\) is differentiable on \((a,b)\), there is \(c \in (a,b)\) with
Rests on Theorem 7.34 and Proposition 7.29.
Derives Theorem 7.35. Apply Rolle to \(\phi(x) = f(x) - f(a) - \dfrac{f(b)-f(a)}{b-a}\,(x - a)\), which is continuous on \([a,b]\), differentiable inside, and vanishes at both endpoints; \(\phi'(c) = 0\) is Equation (7.19).
∎Let \(f\) be continuous on an interval and differentiable at its interior points. If \(f' = 0\) there, \(f\) is constant; if \(f' > 0\) there, \(f\) is strictly increasing — on the whole interval, endpoints included. Rests on Theorem 7.35.
Derives Corollary 7.36. For \(x < y\) in the interval, Theorem 7.35 on \([x,y]\) gives \(f(y) - f(x) = f'(c)(y - x)\) with \(c \in (x,y)\) — an interior point — and the right side vanishes in the first case and is positive in the second.
∎Let \(f, g \in C^{0}([a,b])\) be differentiable on \((a,b)\) with \(g' \neq 0\) there. Then there is \(c \in (a,b)\) with \(\left[f(b)-f(a)\right]g'(c) = \left[g(b)-g(a)\right]f'(c)\). Consequently, if \(f(x_0) = g(x_0) = 0\) and \(\lim_{x \to x_0} f'(x)/g'(x) = L\) exists, then
Rests on Theorem 7.34 and Definition 7.16.
Derives Theorem 7.37. Rolle applied to \(\psi(x) = \left[f(b)-f(a)\right]g(x) - \left[g(b)-g(a)\right]f(x)\) (which takes the value \(f(b)g(a) - g(b)f(a)\) at both ends) gives the first claim. For the second, take \(x \neq x_0\) and apply it on the interval with endpoints \(x_0, x\): since \(f(x_0) = g(x_0) = 0\),
As \(x \to x_0\), also \(c_x \to x_0\), and the right-hand side tends to \(L\).
∎Let \(f\) be \(n+1\) times differentiable on an interval containing \(x_0\) and \(x\). Then
for some \(\xi\) between \(x_0\) and \(x\). Rests on Theorem 7.34 and Proposition 7.30.
Derives Theorem 7.38. Fix \(x\) and let \(M\) be defined by \(f(x) = \sum_{k=0}^{n}\frac{f^{(k)}(x_0)}{k!}(x-x_0)^k + M\,(x-x_0)^{n+1}\). Consider
Then \(g(x) = 0\) and \(g(x_0) = 0\) by the choice of \(M\), so Rolle gives \(\xi\) between \(x_0\) and \(x\) with \(g'(\xi) = 0\). Differentiating the sum in \(t\) telescopes: all terms cancel pairwise except the last, leaving
Setting \(t = \xi\) and dividing by \((x-\xi)^n \neq 0\) yields \(M = f^{(n+1)}(\xi)/(n+1)!\), which is Equation (7.21).
∎The Riemann integral
Let \(f : [a,b] \longrightarrow \R\) be bounded and \(P : a = x_0 < x_1 < \cdots < x_n = b\) a partition. With \(m_i = \inf_{[x_{i-1},x_i]} f\) and \(M_i = \sup_{[x_{i-1},x_i]} f\), the lower and upper sums are
\(f\) is Riemann integrable iff \(\sup_P L(f,P) = \inf_P U(f,P)\), and the common value is the definite integral \(\int_a^b f(x)\,\dd x\). (Both extrema exist by Axiom 7.1: every lower sum is \(\le\) every upper sum, since refining a partition raises \(L\) and lowers \(U\).) Rests on Axiom 7.1.
\(f \in C^{0}([a,b])\) is Riemann integrable. Rests on Definition 7.39, Theorem 7.25 and Theorem 7.24.
Derives Theorem 7.40. Given \(\varepsilon > 0\), Heine–Cantor (Theorem 7.25) provides \(\delta\) with \(\abs{f(x)-f(y)} < \varepsilon/(b-a)\) whenever \(\abs{x-y} < \delta\). For any partition with all steps \(x_i - x_{i-1} < \delta\), the extreme value theorem gives points where \(m_i, M_i\) are attained, at distance \(< \delta\), so \(M_i - m_i < \varepsilon/(b-a)\) and
Upper and lower extrema squeezed within every \(\varepsilon\) coincide.
∎The integral is linear and monotone in \(f\), and additive over subintervals, \(\int_a^b = \int_a^c + \int_c^b\) — each property follows directly from the corresponding property of the Darboux sums.
We define the antiderivative of a function \(f\) as the function \(F\) such that
and we denote it by
By Corollary 7.36, two antiderivatives of the same \(f\) on an interval differ by a constant. Rests on Definition 7.26 and Corollary 7.36.
The fundamental theorem of calculus
Let \(f \in C^{0}([a,b])\) and define \(F(x) = \int_a^x f(t)\,\dd t\). Then \(F\) is differentiable on \((a,b)\) and
Rests on Theorem 7.40, Theorem 7.24 and Definition 7.26.
Derives Theorem 7.42. For \(h > 0\) (the case \(h<0\) is symmetric), additivity gives
On \([x, x+h]\) let \(m_h, M_h\) be the (attained) minimum and maximum of \(f\); monotonicity of the integral squeezes \(m_h \le \frac1h \int_x^{x+h} f \le M_h\). As \(h \to 0\), continuity of \(f\) at \(x\) drives \(m_h, M_h \to f(x)\), and the difference quotient converges to \(f(x)\).
∎If \(f \in C^{0}([a,b])\) and \(G\) is any antiderivative of \(f\), then
Rests on Theorem 7.42 and Definition 7.41.
Derives Theorem 7.43. \(F(x) = \int_a^x f\) is an antiderivative by Theorem 7.42, so \(G = F + C\) for a constant \(C\) (Definition 7.41). Then \(G(b) - G(a) = F(b) - F(a) = \int_a^b f - 0\).
∎For \(C^{1}\) functions on the relevant intervals,
Rests on Theorem 7.43, Proposition 7.31 and Proposition 7.30.
Derives Corollary 7.44. Both sides of Equation (7.27) equal \(F(g(b)) - F(g(a))\) for an antiderivative \(F\) of \(f\), by Theorem 7.43 and the chain rule \(\left(F\circ g\right)' = f(g)\,g'\) (Proposition 7.31). Equation Equation (7.28) is Theorem 7.43 applied to the Leibniz rule \((fg)' = f'g + fg'\) (Proposition 7.30).
∎Series
Given a sequence \((a_n)\), the series \(\sum_{n=0}^{\infty} a_n\) is the limit of its partial sums \(s_N = \sum_{n=0}^{N} a_n\), when it exists. It converges absolutely iff \(\sum \abs{a_n}\) converges. Rests on Definitions 7.2 and 7.4.
For \(\abs{q} < 1\), \(\displaystyle\sum_{n=0}^{\infty} q^{n} = \frac{1}{1-q}\). Rests on Definition 7.45 and Corollary A.46.
Derives Proposition 7.46. \((1-q)\,s_N = 1 - q^{N+1}\), so \(s_N = (1 - q^{N+1})/(1-q)\). Since \(\abs{q}<1\), \(q^{N+1} \to 0\) (its absolute value is decreasing and bounded below, so it converges by monotone convergence, and the limit \(\ell\) satisfies \(\ell = \abs{q}\,\ell\), forcing \(\ell = 0\)).
∎If \(0 \le a_n \le b_n\) and \(\sum b_n\) converges, then \(\sum a_n\) converges. Moreover an absolutely convergent series converges. Rests on Definition 7.45, Corollary A.46 and Theorem 7.8.
Derives Proposition 7.47. The partial sums of \(\sum a_n\) are nondecreasing and bounded above by \(\sum b_n\); monotone convergence (Corollary A.46) concludes. For the second claim, apply the Cauchy criterion (Theorem 7.8): for \(M > N\), \(\abs{s_M - s_N} = \abs{\sum_{N+1}^{M} a_n} \le \sum_{N+1}^{M} \abs{a_n}\), and the right side is the Cauchy difference of the convergent series \(\sum\abs{a_n}\).
∎If \(\limsup_{n} \abs{a_{n+1}/a_n} = r < 1\), then \(\sum a_n\) converges absolutely; if \(\abs{a_{n+1}/a_n} \ge 1\) eventually, it diverges. Rests on Proposition 7.46, Proposition 7.47 and Theorem 7.8.
Derives Proposition 7.48. Pick \(q\) with \(r < q < 1\): beyond some \(N\), \(\abs{a_{n+1}} \le q\abs{a_n}\), so \(\abs{a_{N+k}} \le q^{k}\abs{a_N}\) and comparison with the geometric series (Propositions 7.46 and 7.47) gives absolute convergence. In the divergent case \(\abs{a_n}\) is eventually nondecreasing and nonzero, so \(a_n \not\to 0\), while convergence of a series forces its terms to \(0\) (Cauchy criterion with \(M = N+1\)).
∎Let \(\sum_{n=0}^{\infty} a_n = A\) and \(\sum_{n=0}^{\infty} b_n = B\) converge absolutely. Then their Cauchy product
converges absolutely, with sum \(AB\). Rests on Definition 7.45, Corollary A.46 and Proposition 7.6.
Derives Proposition 7.49. Write \(A^{*} = \sum_n \abs{a_n}\) and \(B^{*} = \sum_n \abs{b_n}\). For any \(N\),
since every product \(\abs{a_k}\abs{b_j}\) with \(k + j \le N\) appears exactly once in the middle double sum and all products are nonnegative. The partial sums of \(\sum\abs{c_n}\) are nondecreasing and bounded, hence convergent (Corollary A.46): the Cauchy product converges absolutely. For its value, compare \(C_N = \sum_{n=0}^{N} c_n\) with the product of partial sums \(A_N B_N\): expanding both, \(A_N B_N - C_N\) consists exactly of the products \(a_j b_k\) with \(j, k \le N\) but \(j + k > N\). Every such pair has \(j > N/2\) or \(k > N/2\) (double counting only enlarges the bound), so
because each tail is the difference between \(A^{*}\) (respectively \(B^{*}\)) and one of its own partial sums, and those partial sums converge to it. Since \(A_N B_N \to AB\) by the algebra of limits (Proposition 7.6), also \(C_N \to AB\).
∎For a power series \(\sum_{n} c_n (x - x_0)^n\) there is \(R \in [0, \infty]\) such that the series converges absolutely for \(\abs{x - x_0} < R\) and diverges for \(\abs{x - x_0} > R\). Rests on Axiom 7.1, Proposition 7.46 and Proposition 7.47.
Derives Theorem 7.50. Let \(S = \set{\rho \ge 0 \mid (\abs{c_n}\rho^n) \text{ is bounded}}\) and \(R = \sup S\) (allowing \(\infty\)). If \(\abs{x - x_0} < R\), pick \(\rho \in S\) with \(\abs{x-x_0} < \rho\) and a bound \(\abs{c_n}\rho^n \le M\); then \(\abs{c_n (x-x_0)^n} \le M\,(\abs{x-x_0}/\rho)^n\), a convergent geometric majorant, so comparison gives absolute convergence. If \(\abs{x - x_0} > R\), the terms \(c_n (x-x_0)^n\) are unbounded (else \(\abs{x-x_0} \in S\)), so they cannot tend to \(0\) and the series diverges.
∎Let \(f(x) = \sum_{n=0}^{\infty} c_n (x - x_0)^n\) have radius of convergence \(R > 0\). Then the derived series \(\sum_{n\ge1} n\,c_n\,(x - x_0)^{n-1}\) has the same radius \(R\), and on \(\abs{x - x_0} < R\) the function \(f\) is differentiable with
Iterating, \(f\) has derivatives of every order inside its radius; in particular it is continuous there. Rests on Theorem 7.50, Proposition 7.48, Proposition 7.47, Proposition 7.6 and Proposition 7.27.
Derives Theorem 7.51. Translate so that \(x_0 = 0\). Same radius. Let \(\abs{x} < R\). As in the proof of Theorem 7.50, pick \(\rho\) in the set \(S\) of that proof with \(\abs{x} < \rho\) (possible because \(R = \sup S > \abs{x}\)) and a bound \(\abs{c_n}\rho^{n} \le M\); then
and \(\sum_n n\,t^{n-1}\) converges for \(0 < t < 1\) by the ratio test (Proposition 7.48: the ratio of consecutive terms is \(\tfrac{n+1}{n}\,t \to t < 1\)), and trivially at \(t = 0\), where only the \(n = 1\) term survives. Comparison (Proposition 7.47) gives absolute convergence of the derived series whenever \(\abs{x} < R\). Conversely \(\abs{c_n x^{n}} \le \abs{x}\cdot n\abs{c_n}\abs{x}^{n-1}\) for \(n \ge 1\), so wherever the derived series converges absolutely the original does too: the two radii coincide. Applying the statement to the derived series itself, \(\sum_{n\ge2} n(n-1)\,c_n\,x^{n-2}\) also has radius \(R\).
The difference quotient. Fix \(\abs{x} < R\), choose \(r\) with \(\abs{x} < r < R\), and let \(y \neq x\) with \(\abs{y} \le r\). Subtracting the two absolutely convergent series term by term and dividing by \(y - x\) (Proposition 7.6 on partial sums),
The factorization \(y^{n} - x^{n} = (y-x)\sum_{k=0}^{n-1} y^{k}x^{n-1-k}\) turns the bracket into \(\sum_{k=0}^{n-1}\left(y^{k} - x^{k}\right)x^{n-1-k}\), and the same factorization once more bounds \(\abs{y^{k} - x^{k}} \le k\,r^{k-1}\abs{y - x}\), so
Multiplying by \(\abs{c_n}\) and summing,
with \(K < \infty\) because \(r < R\) (the twice-derived series above). Letting \(y \to x\), the difference quotient converges to \(\sum_n n\,c_n\,x^{n-1}\), which is Equation (7.30). Differentiability implies continuity (Proposition 7.27), and iterating on the derived series — again a power series of radius \(R\) — yields derivatives of every order.
∎Termwise integration is the mirror statement: the antiderivative series \(\sum_n c_n (x - x_0)^{n+1}/(n+1)\) has the same radius (the same comparison, run backwards) and differentiates termwise back to \(f\) by Theorem 7.51. Both are used freely in Complex Analysis, where power series become the definition of analyticity.
Named real numbers: $\ee$, $\pi$, $\varphi$
Three real numbers are named in this treatise rather than measured. \(\ee\) and \(\pi\) recur in every branch of it, from the oscillator of Oscillations and Mechanical Waves to the phase factors of Part IX — Quantum Mechanics. The golden ratio \(\varphi\) is far rarer, and where it appears it is always its irrationality that is doing the work rather than its value: it is the number whose irrationality denies a crystal a five-fold axis (Proposition 125.2), and the number whose continued fraction Equation (7.80) makes the golden-mean winding number the last invariant curve to break in Proposition 32.55. All three are constructed here from the machinery just built, and none is quoted as a decimal approximation.
They are not of one kind, and Remark 7.94 says where the line falls: \(\varphi\) is a root of a quadratic with integer coefficients, while \(\ee\) and \(\pi\) satisfy no polynomial equation whatever. That difference is worth more than the resemblance.
Let \((b_n)_{n\ge0}\) be a nonincreasing sequence of nonnegative reals with \(b_n \to 0\). Then \(\sum_{n=0}^{\infty}(-1)^n b_n\) converges, and its sum \(S\) satisfies \(S_1 \le S \le S_0 = b_0\), where \(S_N\) denotes the \(N\)-th partial sum. Rests on Definition 7.45 and Corollary A.46.
Derives Proposition 7.52. The even partial sums are nonincreasing, \(S_{2k+2} - S_{2k} = -b_{2k+1} + b_{2k+2} \le 0\), and bounded below by \(S_1\) (since \(S_{2k+1} \le S_{2k+2} \le S_{2k}\), shown by the same computation applied once more); the odd partial sums are nondecreasing and bounded above by \(S_0\) by the mirror argument. Both are monotone and bounded, hence convergent (Corollary A.46), to limits \(S_{\mathrm{e}}\) and \(S_{\mathrm{o}}\) respectively; since \(S_{2k} - S_{2k+1} = b_{2k+1} \to 0\), \(S_{\mathrm{e}} = S_{\mathrm{o}} =: S\). Monotonicity of each subsequence gives \(S_1 \le S \le S_0\).
∎Figure 7.5 shows the mechanism at work: each pair of consecutive partial sums traps the limit in an interval of width \(b_{N+1} \to 0\), which is what makes the test also an error bound — the property Lemma 7.73 will exploit.
The alternating series test (Proposition 7.52) on \(\sum_{n}(-1)^{n}b_n\) with \(b_n = 1/(n+1)\). Even partial sums descend, odd partial sums ascend, and every consecutive pair brackets the sum \(S\) in a nested interval of width \(b_{N+1}\).
Euler's number
Rests on Definition 7.45 and Proposition 7.48.
The series converges absolutely by the ratio test (Proposition 7.48: the ratio of consecutive terms is \(1/(n+1) \to 0\)).
Convergence by itself yields no digit. What turns Equation (7.31) into a computational definition is that its truncation error admits a closed bound, and one sharp enough that a dozen terms already settle nine decimals.
Let \(s_{n}=\sum_{k=0}^{n}1/k!\) denote the \(n\)-th partial sum of Equation (7.31). Then for every integer \(n\ge1\),
Rests on Equation (7.31) and Proposition 7.46.
Derives Lemma 7.54. The tail \(\ee-s_{n}=\sum_{k=n+1}^{\infty}1/k!\) has positive terms, so it is at least its first term \(1/(n+1)!\); that is the left inequality. For the right one, put \(k=n+1+j\) with \(j\ge0\) and factor out \(1/(n+1)!\):
the empty product at \(j=0\) being \(1\). Each of the \(j\) factors obeys \(n+i\ge n+2>n+1\), so the product is at most \((n+1)^{-j}\), strictly so once \(j\ge1\). The comparison series is geometric with ratio \(1/(n+1)\in(0,1)\), hence summable (Proposition 7.46), and
The two bounds trap \(\ee\) between two rationals computable in finitely many integer operations, and the width of the trap collapses faster than any geometric rate. This is what produces digits.
Rests on Lemma 7.54.
Derivation. Derives Corollary 7.55. Take \(n=12\) in Lemma 7.54. Over the common denominator \(12!=479001600\) the partial sum is a ratio of integers obtained by finitely many additions, with no limit process anywhere:
The error bound is \(1/(12\cdot12!)=1/5748019200\), itself smaller than \(1.74\times 10^{-10}\). Carrying out the two divisions to sixteen decimals — rounding the lower endpoint down and the upper endpoint up, so that the enclosure is certain — Equation (7.32) gives
The endpoints agree in their first nine decimals, so every real number between them — \(\ee\) among them — begins \(2.718281828\).
∎Nothing about \(n=12\) is special: raising \(n\) narrows Equation (7.36) at will: the error bound at \(n=15\) is \(1/(15\cdot15!) < 5.1\times 10^{-14}\), fixing thirteen decimals. What the argument does not do is terminate. No finite decimal is ever reached, and the next result explains why not.
\(\ee\notin\Q\). Consequently its decimal expansion neither terminates nor becomes periodic, and no finite decimal equals \(\ee\): Equation (7.34) records the opening digits of an expansion that never ends. Rests on Definition 7.53 and Lemma 7.54.
Derives Proposition 7.56. Suppose \(\ee=p/q\) with \(p,q\) positive integers, and set \(n=\max\{q,2\}\). Consider
Every \(n!/k!\) with \(k\le n\) is an integer, so the sum is an integer; and \(n!\,\ee=n!\,p/q\) is an integer because \(q\le n\) makes \(q\) a divisor of \(n!\). Hence \(x\in\Z\). Multiplying Equation (7.32) by \(n!>0\), however,
so \(x\) is an integer lying strictly between \(0\) and \(1\). No such integer exists, and the assumption fails.
∎Rests on Definition 7.53, Equation (5.3) and Proposition 7.6.
Derives Proposition 7.57. By the binomial theorem (Equation (5.3)),
using \(\binom{n}{k}/n^{k} = \frac{1}{k!}\prod_{j=0}^{k-1}(n-j)/n = \frac{1}{k!}\prod_{j=0}^{k-1}(1-j/n)\). Each factor \(1-j/n \in (0,1]\), so every term of Equation (7.38) is at most \(1/k!\); summing,
the last step because a partial sum of a convergent series of positive terms is bounded by the full sum. This gives \(\limsup_n (1+1/n)^n \le \ee\). Conversely, fix \(N\); for \(n \ge N\), truncating Equation (7.38) at \(k=N\) (dropping the remaining nonnegative terms) gives
For each fixed \(k \le N\), the product \(\to 1\) as \(n \to \infty\) (a finite product of terms each \(\to 1\), by Proposition 7.6), so the right side \(\to \sum_{k=0}^{N} 1/k!\) as \(n \to \infty\). Hence \(\liminf_n (1+1/n)^n \ge \sum_{k=0}^{N} 1/k!\) for every \(N\), and letting \(N \to \infty\), \(\liminf_n(1+1/n)^n \ge \ee\). The limsup and liminf bounds coincide, so the limit exists and equals \(\ee\).
∎Proposition 7.57 is often taken as the definition of \(\ee\), but it is useless for computing one, and the reason is already visible in its proof. Every bracket in
— Equation (7.38) subtracted from Equation (7.31) — is nonnegative, since each factor \(1-j/n\) lies in \((0,1]\). Keeping only the term \(k=2\), whose bracket is exactly \(1-(1-1/n) = 1/n\), gives
The error therefore cannot fall faster than \(1/n\): one further decimal per tenfold increase in \(n\). Matching the nine decimals that Equation (7.35) obtains from twelve terms would take \(n>5\times 10^{8}\) at the very least, and the thirteen decimals available at \(n=15\) would take \(n>5\times 10^{12}\). The factorial series converges faster than any geometric rate and the limit slower than one; that asymmetry, not tradition, is why Equation (7.31) is the definition here and Equation (7.37) a theorem about it. Rests on Proposition 7.57, Equation (7.38) and Lemma 7.54.
with the usual power-series convention \(x^{0} = 1\) for every \(x\), including \(x = 0\). The series converges absolutely at every \(x\): for \(x \neq 0\) the ratio of consecutive terms is \(\abs{x}/(n+1) \to 0\) (Proposition 7.48), and at \(x = 0\) only the term \(n = 0\) is nonzero, so \(\exp(0) = 1\). Rests on Definition 7.45, Proposition 7.48 and Theorem 7.50.
By Theorem 7.50 the radius is infinite; \(\exp(1) = \ee\) is Definition 7.53, and Equation (7.41) extends to the complex exponential \(\ee^{z}\) of Definition 8.3 without changing a single coefficient. Differentiating Equation (7.41) termwise (Theorem 7.51) and re-indexing \(n = m+1\) shifts the series onto itself, so
Every later derivative of an exponential in this chapter is Equation (7.42) with the chain rule.
The exponential, the logarithm, and general powers
Writing \(\ee^{x}\) for \(\exp(x)\) presumes a law of exponents that the series does not wear on its face. That law is the next lemma, and it is the single fact from which the logarithm, arbitrary real powers, and the characterisation of \(\ee\) in Proposition 7.68 all follow.
For all \(x, y \in \R\),
and consequently \(\exp(x) > 0\) for every \(x\), with \(\exp(-x) = 1/\exp(x)\). Rests on Definition 7.59, Proposition 7.49, Equation (5.3) and Corollary A.46.
Derives Lemma 7.60. Both series converge absolutely (Definition 7.59), so their Cauchy product converges to the product of their sums (Proposition 7.49). Its \(n\)-th term is
multiplying and dividing by \(n!\) and then applying the binomial theorem (Equation (5.3)). Summing over \(n\) gives Equation (7.43).
Positivity follows: \(\exp(x)\exp(-x) = \exp(0) = 1\) by Definition 7.59, so \(\exp\) vanishes nowhere and \(\exp(-x) = 1/\exp(x)\). For \(x \ge 0\) every term of the series is nonnegative and the first is \(1\), so \(\exp(x) \ge 1 > 0\); for \(x < 0\), \(\exp(x) = 1/\exp(-x) > 0\).
∎\(\exp\) is a strictly increasing bijection of \(\R\) onto \((0,\infty)\). Its inverse, the natural logarithm \(\ln : (0,\infty) \longrightarrow \R\), is strictly increasing and differentiable with
and \(\exp(\ln y) = y\), \(\ln(\exp x) = x\). Rests on Lemma 7.60, Equation (7.42), Proposition 7.27, Theorem 7.23, Corollary 7.36, Corollary A.46 and Proposition 7.32.
Derives Proposition 7.61. By Equation (7.42), \(\exp' = \exp\), which is positive by Lemma 7.60, so \(\exp\) is strictly increasing (Corollary 7.36) and hence injective; being differentiable it is continuous (Proposition 7.27). For \(x > 0\) every term of Equation (7.41) is nonnegative and the partial sum after two terms is \(1 + x\), so \(\exp(x) \ge 1 + x\) (a nondecreasing sequence of partial sums exceeds each of them in the limit, Corollary A.46). Hence \(\exp(x) \to \infty\) as \(x \to \infty\), and \(\exp(-x) = 1/\exp(x) \to 0\); by the intermediate value theorem (Theorem 7.23) on \([-M, M]\) with \(M\) large enough, \(\exp\) attains every value of \((0,\infty)\). So \(\exp\) is a bijection onto \((0,\infty)\), \(\ln\) is defined as its inverse, and the two composition identities are what "inverse" means. Being the inverse of a strictly increasing bijection, \(\ln\) is strictly increasing.
\(\exp\) is strictly monotonic, continuous and differentiable with \(\exp'(\ln y) = \exp(\ln y) = y \neq 0\), so the derivative of the inverse (Proposition 7.32) applies and gives \(\ln' y = 1/y\). Applying \(\ln\) to Equation (7.43) with \(y_{i} = \exp(x_{i})\) turns the product into the sum; \(\ln 1 = 0\) because \(\exp(0) = 1\) (Definition 7.59); and \(\ln \ee = 1\) because \(\exp(1) = \ee\).
∎For \(b > 0\) and \(x \in \R\),
Rests on Proposition 7.61.
Let \(b, c > 0\) and \(x, y \in \R\). Then \(b^{x} > 0\) and
\(b^{n}\) agrees with the \(n\)-fold product for \(n \in \Z\), and
Rests on Definition 7.62, Lemma 7.60, Proposition 7.61, Equation (7.42) and Proposition 7.31.
Derives Proposition 7.63. Positivity is Lemma 7.60. The first law is \(\exp((x+y)\ln b) = \exp(x\ln b)\exp(y\ln b)\), which is Equation (7.43). The second is \(\ln(b^{x}) = \ln\exp(x\ln b) = x\ln b\), by the composition identity of Proposition 7.61 — and it is what the third needs, since
(The third law does not follow from the functional equation alone; it is the inverse property that carries it.) The fourth is the product law of Equation (7.44): \((bc)^{x} = \exp(x\ln b + x\ln c) = b^{x}c^{x}\). Next \(b^{1} = \exp(\ln b) = b\), again by Proposition 7.61. Agreement with the \(n\)-fold product is then induction: \(b^{0} = \exp(0) = 1\), and \(b^{n+1} = b^{n}b^{1} = b^{n}\,b\) by the first law and \(b^{1} = b\); negative \(n\) follows from \(b^{-n} = 1/b^{n}\) (Lemma 7.60). Finally \(x \mapsto x\ln b\) has derivative \(\ln b\) and \(\exp' = \exp\) (Equation (7.42)), so the chain rule (Proposition 7.31) gives Equation (7.47).
∎The notation \(\ee^{x}\) is now literally Equation (7.45) with \(b = \ee\), which is \(\exp(x)\) because \(\ln \ee = 1\).
The natural base
Definition 7.53 produces \(\ee\) from a series and Proposition 7.57 recovers it as a limit, but neither says why this number, rather than \(2\) or \(10\), deserves to be called the natural base. The answer is visible already at the level of finite differences, before any limit is taken, and it is worth setting down in that form because it is the form in which exponential behaviour is met in physics: a quantity whose growth over one step is governed by nothing but its own size.
Let a quantity \(X\) evolve as
so that \(X(0) = X_{0}\) and advancing \(t\) by the step \(h = 1/r\) multiplies \(X\) by \(b\). The pair \((b,r)\) is redundant: for any \(r' > 0\), putting \(b' = b^{r/r'}\) leaves Equation (7.48) unchanged, since \(b'^{\,r't} = b^{(r/r')(r't)} = b^{rt}\) by the power-of-power law (Equation (7.46)). Only the combination \(b^{r}\) is determined by the motion — \(X(t) = X_{0}(b^{r})^{t}\), so \(b^{r} = X(1)/X_{0}\) — and a choice of \(r\) fixes \(b\). The following proposition makes one such choice canonical.
The limit that appears in it runs over real \(r\), whereas Proposition 7.57 is a statement about the integer-indexed sequence \((1+1/n)^{n}\); its proof expands \((1+1/n)^{n}\) into \(n+1\) binomial terms and so does not extend to a real exponent. The gap is closed by squeezing between two integer cases.
Every nonempty \(S \subseteq \N\) has a least element. Rests on Axioms 3.33 and 3.34.
Derives Lemma 7.64. Suppose \(S\) has none, and let \(P(n)\) be the predicate “no \(k \le n\) lies in \(S\)”. \(P(1)\) holds: \(1\) is the least element of \(\N\) (Axiom 3.33), so \(1 \in S\) would make \(1\) least in \(S\). If \(P(n)\) holds then no \(k \le n\) is in \(S\), so \(n+1 \in S\) would again make \(n+1\) least in \(S\); hence \(P(n+1)\). By induction (Axiom 3.34) \(P(n)\) holds for every \(n\), so \(S\) is empty — a contradiction.
∎For every real \(x \ge 0\) there is a unique integer \(m \ge 0\) with \(m \le x < m+1\), written \(m = \lfloor x \rfloor\). Rests on Corollary A.45, Lemma 7.64 and Axiom 3.33.
Derives Lemma 7.65. Applying Corollary A.45 with \(\alpha = 1\) and \(\beta = x\) gives an \(n \in \N\) with \(n > x\), so \(S = \set{k \in \N : k > x}\) is nonempty and has a least element \(\mu\) (Lemma 7.64). Put \(m = \mu-1\), an integer with \(m \ge 0\) because \(\mu \ge 1\) (Axiom 3.33: \(\N\) begins at \(1\)). If \(m = 0\) then \(m \le x\) is the hypothesis \(x \ge 0\); if \(m \ge 1\) then \(m \in \N\) and \(m < \mu\), so \(m \notin S\) by minimality, which again gives \(m \le x\). And \(\mu \in S\) gives \(x < \mu = m+1\).
Uniqueness: if \(m\) and \(m'\) both satisfy the condition then \(m < m'+1\) and \(m' < m+1\), so \(\abs{m-m'} < 1\), and distinct integers differ by at least \(1\).
∎Axiom 3.33 gives \(\N\) the distinguished element \(1\), not \(0\), so \(\lfloor x \rfloor\) is stated above as an integer \(\ge 0\) rather than as a member of \(\N\): the value at \(x \in [0,1)\) is \(0\), which this treatise counts in \(\Z\) and not in \(\N\).
Rests on Proposition 7.57, Proposition 7.63, Proposition 7.6, Lemma 7.65, Definition 7.19, Proposition 7.61 and Corollary 7.36.
Derives Lemma 7.67. Let \(r \ge 1\) and let \(n = \lfloor r \rfloor\) (Lemma 7.65), so that \(n \ge 1\) and \(n \le r < n+1\). Then
Two monotonicities are needed. For a fixed base \(b > 1\) the map \(x \mapsto b^{x}\) is increasing, since its derivative \((\ln b)b^{x}\) is positive (Equation (7.47) and Corollary 7.36, with \(\ln b > 0\) because \(\ln\) is increasing and \(\ln 1 = 0\), Equation (7.44)). For a fixed exponent \(x > 0\) the map \(b \mapsto b^{x} = \exp(x\ln b)\) is increasing on \((0,\infty)\), being a composition of the increasing maps \(\ln\), multiplication by \(x > 0\), and \(\exp\) (Proposition 7.61). Combining the two with \(n \le r < n+1\),
Both bounds are sequences in \(n\) tending to \(\ee\): the right side is \((1+1/n)^{n}\,(1+1/n)\) and the left is \((1+1/(n+1))^{n+1}\bigl/(1+1/(n+1))\), and in each case Proposition 7.57 and Proposition 7.6 give \(\ee\cdot1\) and \(\ee/1\).
It remains to pass from the two integer-indexed bounds to a limit over the reals, which is the step the lemma exists to perform and is therefore made explicitly. Let \(\varepsilon > 0\). Choose \(N\) so that both bounds lie within \(\varepsilon\) of \(\ee\) for every integer \(m \ge N\). If \(r \ge N+1\) then \(n = \lfloor r \rfloor > r-1 \ge N\), so both bounds at that \(n\) are within \(\varepsilon\) of \(\ee\); since they sandwich \((1+1/r)^{r}\), that value is too. Hence \(\abs{(1+1/r)^{r} - \ee} < \varepsilon\) for every \(r \ge N+1\), which is Equation (7.49) in the sense of Definition 7.19.
∎Let \(X\) be as in Equation (7.48), let \(h = 1/r\), and let \(\sigma \in \set{+1,-1}\). The forward difference quotient of \(X\) over the step \(h\) equals \(\sigma X\) at every \(t\),
if and only if
(which requires \(r > 1\) when \(\sigma = -1\)). In that case
and hence, for each fixed \(t\), \(X(t) \to X_{0}\ee^{\sigma t}\) as the step shrinks. Rests on Equation (7.48), Lemma 7.67, Proposition 7.63, Lemma 7.60, Proposition 7.61, Proposition 7.6 and Proposition 7.27.
Derives Proposition 7.68. Since \(rh = 1\), Equation (7.48) gives \(X(t+h) = X_{0}b^{rt+1} = b\,X(t)\), using \(b^{rt+1} = b^{rt}b^{1}\) and \(b^{1} = b\) (Equation (7.46)). So the left side of Equation (7.50) is \((b-1)r\,X(t)\). The power \(b^{rt}\) is positive (Proposition 7.63) and \(X_{0}\neq0\), so \(X(t) \neq 0\) and the condition holds at every \(t\) if and only if \((b-1)r = \sigma\), which is Equation (7.51); the constraint \(b > 0\) is automatic for \(\sigma = +1\) and reads \(r > 1\) for \(\sigma = -1\). Substituting into Equation (7.48) and using \((b^{r})^{t} = b^{rt}\) (Equation (7.46)) gives the first half of Equation (7.52).
For the limit, \(\sigma = +1\) is Lemma 7.67. For \(\sigma = -1\) put \(s = r-1\), which tends to \(\infty\) through the reals with \(r\); then \(1 - 1/r = (r-1)/r = s/(s+1)\) and the exponent \(r\) is \(s+1\), so
the middle step by Equation (7.46) and the limit by Lemma 7.67 and Proposition 7.6.
Finally, for fixed \(t\) the map \(c \mapsto c^{t} = \exp(t\ln c)\) is continuous at \(c = \ee^{\sigma} > 0\), being a composition of \(\ln\) and \(\exp\), both continuous (Proposition 7.61, Proposition 7.27); so the convergence of the bases carries over to the values, \(X(t) \to X_{0}\ee^{\sigma t}\).
∎For \(b > 0\) the function \(x \mapsto b^{x}\) is its own derivative if and only if \(b = \ee\). Rests on Equation (7.47) and Proposition 7.61.
Derives Corollary 7.69. By Equation (7.47) the derivative is \((\ln b)b^{x}\), and \(b^{x} > 0\) never vanishes, so the two agree everywhere exactly when \(\ln b = 1\), that is when \(b = \exp(1) = \ee\) (Proposition 7.61: \(\ln\) is injective).
∎More generally, for \(X\) as in Equation (7.48) the continuum condition \(X' = \sigma X\) reads \(r\ln b = \sigma\), that is \(b^{r} = \ee^{\sigma}\): at each rate \(r\) exactly one base, and Corollary 7.69 is the instance \(r = 1\), \(\sigma = +1\). The base is pinned to \(\ee\) itself only once the step, or equivalently the time unit, has been fixed — which is the continuum face of the redundancy noted before Proposition 7.68.
Equation (7.50) is a self-reference condition: it demands that the increment of \(X\) across one step be dictated by \(X\) itself and by nothing else — no external scale, no reference level, no second parameter. Proposition 7.68 says that this demand fixes the base uniquely at each step size, and that the fixed bases converge to \(\ee^{\pm1}\) as the step shrinks. The continuum condition \(X' = \sigma X\) behaves the same way, fixing one base \(b = \ee^{\sigma/r}\) per rate; Corollary 7.69 is its \(r = 1\), \(\sigma = +1\) case, where the base is \(\ee\) itself. Two consequences are worth separating.
First, the base is a matter of bookkeeping and the rate is not. Any \(b^{rt}\) with \(b \neq \ee\) is \(\ee^{\lambda t}\) with \(\lambda = r\ln b\) (Definition 7.62), so nothing physical distinguishes a half-life quoted in base \(2\) from a mean life quoted in base \(\ee\); what the two share is \(\lambda\), the invariant of the reparametrisation noted before Proposition 7.68. Radioactive decay is the worked case: Nuclear Forces and Nuclear Structure writes the law as \(N(t) = N(0)\ee^{-\lambda t}\) and the half-life as \(\ln 2/\lambda\), the \(\ln 2\) being exactly the conversion between the two bases. The damped oscillator of Oscillations and Mechanical Waves is the same structure with \(\lambda\) complex. Neither system contains a \(2.718\ldots\) anywhere in its constitution.
Second, the convergence in Equation (7.52) is slow. Equation (7.40) makes this precise along the integers and for \(\sigma = +1\) — the error is at least \(1/(2n)\) — and the squeeze of Lemma 7.67 carries the same order to real \(r\), since the bounding sequences are the ones just estimated; the decaying branch behaves the same way by the reciprocal identity used in the proof. So reading \(\ee\) off a plot of \(r \mapsto (1+1/r)^{r}\) against its asymptote, as in Figure 7.6, exhibits the number but does not compute it. The digits come from Corollary 7.55 and the series, never from the limit. Rests on Proposition 7.68, Corollary 7.69 and Remark 7.58.
The natural base. Left: over the step \(h=1/r\) the chord of \(X(t)=X_{0}b^{rt}\) rises by \((b-1)r\,X(t)\) per unit time, so requiring that rise to equal \(X(t)\) itself (Equation (7.50)) forces \(b=1+1/r\) (Proposition 7.68); the chord then has the same slope as the value it starts from. Right: the bases so fixed, \((1\pm1/r)^{r}\), approach \(\ee\) and \(\ee^{-1}\) as the step shrinks. The approach is of order \(1/r\) (Remark 7.58), which is why the plot displays the two numbers without computing them.
The number $\pi$
The trigonometric functions are defined, on \(\R\), by the same series used in Definition 8.3 restricted to real argument:
both with infinite radius of convergence (ratio test, as for \(\ee^x\)).
For every \(x \in \R\),
Rests on Equation (7.53), Theorem 7.51, Proposition 7.49 and Equation (5.3).
Derives Lemma 7.71. Derivatives. Termwise differentiation (Theorem 7.51) of Equation (7.53) gives
and, re-indexing \(n = m + 1\) in the derived series of \(\cos\),
Pythagorean identity. Both series converge absolutely at every \(x\), so each square is a Cauchy product (Proposition 7.49). Squaring the cosine series, the terms \(a_j = (-1)^{j}x^{2j}/(2j)!\) collect at fixed \(j + k = n\) into
multiplying and dividing by \((2n)!\) in the last step. The same computation squares the sine series (terms \((-1)^{j}x^{2j+1}/(2j+1)!\), product powers \(x^{2n+2}\), then re-indexed so the power reads \(x^{2n}\)):
Adding the two, the constant term is \(1\) and the coefficient of \(x^{2n}\) for \(n \ge 1\) is
by the binomial theorem (Equation (5.3)): the two brackets are the even and the odd halves of \(\sum_{i=0}^{2n}(-1)^{i}\binom{2n}{i}\). Hence \(\sin^{2}x + \cos^{2}x = 1\). (Once the derivatives are known the identity also follows in one line — \((\sin^{2} + \cos^{2})' = 2\sin\cos - 2\cos\sin = 0\), so the function is constant (Corollary 7.36) with value \(1\) at \(x = 0\); the Cauchy-product computation above is that statement read coefficient by coefficient.)
∎The Cauchy product that produced the Pythagorean identity produces the addition theorems as well, and by exactly the same route. This is worth doing here rather than importing it: the identities are quoted in Section 5.1.2 and derived there from Euler's formula (Proposition 8.4), which belongs to a later chapter, whereas the argument below uses nothing beyond Equation (7.53) and the binomial theorem. Everything this chapter goes on to prove about \(\pi\) rests on it.
For all \(x, y \in \R\),
Rests on Equation (7.53), Proposition 7.49, Equation (5.3), Proposition 7.48 and Proposition 7.6.
Derives Lemma 7.72. Write \(a_{j} = (-1)^{j}x^{2j}/(2j)!\) and \(b_{k} = (-1)^{k}y^{2k}/(2k)!\) for the terms of \(\cos x\) and \(\cos y\), and \(\alpha_{j} = (-1)^{j}x^{2j+1}/(2j+1)!\), \(\beta_{k} = (-1)^{k}y^{2k+1}/(2k+1)!\) for those of \(\sin x\) and \(\sin y\). All four series converge absolutely at every real argument (ratio test, as for Equation (7.41)), so Proposition 7.49 applies to each product below. Note that it is used only in the diagonal grouping it states — no rearrangement of an unordered double sum is required anywhere.
Cosine. Expand \((x+y)^{2n}\) by the binomial theorem (Equation (5.3)) inside Equation (7.53) and use \(\binom{2n}{i}/(2n)! = 1/\bigl(i!\,(2n-i)!\bigr)\):
Split the inner sum by the parity of \(i\); both halves converge, so the series splits in two (Proposition 7.6). The terms with \(i = 2j\) leave \(2n-i = 2(n-j)\) even, and putting \(k = n-j\) the inner sum runs over \(j + k = n\), giving
by Proposition 7.49 — this is literally its \(c_{n}\), since \((-1)^{n} = (-1)^{j+k}\). The terms with \(i = 2j+1\) leave \(2n-i = 2(n-j)-1\) odd, and putting \(k = n-j-1 \ge 0\) the inner sum runs over \(j+k = n-1\), so with \((-1)^{n} = -(-1)^{j+k}\) they give
again by Proposition 7.49, the outer index shifted by one. Adding the two halves gives Equation (7.55).
Sine. The same expansion of \((x+y)^{2n+1}\) gives
and splitting by the parity of \(i\) with \(k = n-j\) in both cases gives inner sums over \(j+k = n\) again. The terms \(i = 2j\) leave the odd power \(y^{2k+1}\) and collect as \(\sum_{n}\sum_{j+k=n}a_{j}\beta_{k} = \cos x\sin y\); the terms \(i = 2j+1\) leave the even power \(y^{2k}\) and collect as \(\sum_{n}\sum_{j+k=n}\alpha_{j}b_{k} = \sin x\cos y\). Their sum is Equation (7.56).
∎Putting \(y = x\) in Lemma 7.72 gives the double-angle formulas, and combining the second of them with the Pythagorean identity (Lemma 7.71) gives the half-angle formulas, both used repeatedly below:
Replacing \(y\) by \(-y\) and using that \(\cos\) is even and \(\sin\) odd — immediate from Equation (7.53), which carries only even and only odd powers respectively — turns Lemma 7.72 into the subtraction formulas. These are the identities collected in Section 5.1.2, now available without leaving this chapter.
Rests on Equation (7.53) and Proposition 7.52.
Derives Lemma 7.73. At \(x=2\) the terms of Equation (7.53) have magnitude \(t_n = 2^{2n}/(2n)!\); for \(n \ge 1\),
so \((t_n)_{n\ge1}\) is nonincreasing (and \(t_n\to0\)). By Proposition 7.52 applied to the tail starting at \(n=2\), the sum \(S = \sum_{n=2}^{\infty}(-1)^{n}t_n = t_2 - t_3 + t_4 - \cdots\) satisfies \(0 \le S \le t_2 = 16/24 = 2/3\). Since \(\cos 2 = t_0 - t_1 + S = 1 - 2 + S = -1 + S\),
in particular \(\cos 2 < 0\).
∎By Lemma 7.73, \(\cos 0 = 1 > 0\), and \(\cos\) is continuous (Theorem 7.51: a power series is differentiable, hence continuous, inside its radius — here infinite). The intermediate value theorem (Theorem 7.23) applied to \(\cos\) on \([0,2]\) gives at least one zero (Figure 7.7); let
a nonempty set bounded below by \(0\) and above by \(2\), so \(z\) exists by completeness (Axiom 7.1) and \(\cos z = 0\) by continuity (a limit of a sequence of zeros approaching the infimum, or directly: \(\cos > 0\) on \([0,z)\) by minimality of \(z\), and \(\cos z \le 0\) by continuity from the right, forcing \(\cos z = 0\)). We define
Rests on Lemma 7.73, Theorem 7.51, Theorem 7.23 and Axiom 7.1.
Left: the series Equation (7.53) pin \(\cos 0 = 1\) and \(\cos 2 \le -\tfrac13\) (Lemma 7.73), so the first positive zero \(z = \pi/2\) of \(\cos\) exists by the intermediate value theorem (Definition 7.74). Right: on \([0,z]\) the path \(t \mapsto (\cos t, \sin t)\) traverses a quarter of the unit circle once, at unit speed, so the arc has length exactly \(z\) (Proposition 7.76).
Three facts about the first quadrant follow at once, and are separated out here because the circle theorem, the special values and the polygon recursion all consume them.
Write \(z = \pi/2\). Then
\(\sin > 0\) on \((0,z]\), and \(\cos\) is strictly decreasing on \([0,z]\). Rests on Definition 7.74, Lemma 7.71, Corollary 7.36, Theorem 7.23 and Theorem 7.51.
Derives Lemma 7.75. \(\cos > 0\) on \([0,z)\) by the minimality of \(z\) in Definition 7.74: \(\cos 0 = 1 > 0\) and \(\cos\) has no zero below \(z\), so by the intermediate value theorem (Theorem 7.23) it cannot change sign there. Since \(\sin' = \cos > 0\) on the interior (Lemma 7.71), \(\sin\) is strictly increasing on \([0,z]\) (Corollary 7.36); from \(\sin 0 = 0\) it is therefore positive on \((0,z]\). Then \(\cos z = 0\), so \(\sin^{2}z = 1 - \cos^{2}z = 1\) (Lemma 7.71), and positivity forces \(\sin z = 1\). Finally \(-\cos\) has derivative \(\sin > 0\) on the interior, so \(-\cos\) is strictly increasing and \(\cos\) strictly decreasing on \([0,z]\) — the corollary states only the increasing case, which is why it is applied to \(-\cos\).
∎The arc length of a continuously differentiable path \(\gamma : [a,b] \longrightarrow \R^{2}\) is \(\int_{a}^{b}\abs{\gamma'(t)}\,\dd t\), the integral of its speed — the notion taken up systematically in Definition 13.11. Only two of its immediate properties are needed here: reflections preserve it, since they leave the speed \(\abs{\gamma'}\) unchanged, and the circumference of a circle is the sum of the lengths of arcs covering it with only endpoints in common.
The arc length of the unit circle is \(2\pi\). Rests on Definition 7.74, Lemma 7.75, Lemma 7.71, Theorem 7.23 and Definition 13.11.
Derives Proposition 7.76. By Lemma 7.75, \(\cos > 0\) on \([0,z)\), \(\sin\) is strictly increasing on \([0,z]\) and positive on \((0,z]\), and \(\sin z = 1\). The path \(t \mapsto (\cos t, \sin t)\), \(t \in [0,z]\), therefore lies on the unit circle by the Pythagorean identity, starts at \((1,0)\), ends at \((0,1)\), and traverses the first-quadrant arc exactly once: \(\sin\) is a continuous strictly increasing bijection of \([0,z]\) onto \([0,1]\) (Theorem 7.23), and on that arc the height \(\sin t\) determines the point, since \(\cos t \ge 0\). The speed of the path is
(both parts of Lemma 7.71), so its arc length is \(\int_{0}^{z} 1 \,\dd t = z\). The reflections \((x,y) \mapsto (-x,y)\) and \((x,y) \mapsto (x,-y)\) map the unit circle to itself and preserve arc length, so the four quadrantal arcs have the same length \(z\), and the full circumference is \(4z = 2\pi\).
∎Scaling by \(r > 0\) multiplies every arc length by \(r\) (the scaled path \(r\gamma\) has speed \(r\abs{\gamma'}\), pulling the factor \(r\) out of the integral), so a circle of radius \(r\) has circumference \(2\pi r\): the circumference of any circle is \(\pi\) times its diameter (Figure 7.8).
The circle constant, reduced to its emblem: a circle of diameter \(1\) has circumference \(\pi\) (Proposition 7.76). The number so drawn — twice the first positive zero of \(\cos\) (Definition 7.74) — is the same \(\pi\) in every formula of this treatise.
Definition 7.74 fixes \(\cos(\pi/2) = 0\), and Lemma 7.75 adds \(\sin(\pi/2) = 1\) together with the signs of \(\cos\) and \(\sin\) on the first quadrant. Everything else the treatise assumes about \(\pi\) — that \(\sin\pi = 0\) and \(\cos\pi = -1\), that the trigonometric functions have period \(2\pi\), and that \(2\pi\Z\) is exactly the set of angles at which \(\cos\) returns to \(1\) and \(\sin\) to \(0\) — follows from those and Lemma 7.72, and is collected next. The last of these is the statement consumed by the argument lift of Lemma 6.19 and by every \(2\pi\ii\) of Complex Analysis.
and
Both functions have period \(2\pi\); \(\cos > 0\) on \([0,\pi/2)\); \(\sin > 0\) on \((0,\pi)\) and \(\sin < 0\) on \((\pi, 2\pi)\); and for \(\theta \in \R\),
Rests on Definition 7.74, Lemma 7.75, Lemma 7.72, Lemma 7.65 and Equation (7.58).
Derives Proposition 7.77. Values and the sign of \(\cos\). \(\cos(\pi/2) = 0\) is Definition 7.74; \(\sin(\pi/2) = 1\) and \(\cos > 0\) on \([0,\pi/2)\) are Lemma 7.75. The double-angle formulas Equation (7.57) at \(x = \pi/2\) give \(\cos\pi = 0 - 1 = -1\) and \(\sin\pi = 2\cdot1\cdot0 = 0\); the same formulas at \(x = \pi\) give \(\cos 2\pi = 1 - 0 = 1\) and \(\sin 2\pi = 0\). For Equation (7.62), the half-angle formula Equation (7.58) at \(x = \pi/4\) gives \(2\cos^{2}(\pi/4) = 1 + \cos(\pi/2) = 1\), and \(\cos(\pi/4) > 0\) since \(\pi/4 \in [0,\pi/2)\), so \(\cos(\pi/4) = 1/\sqrt{2}\); then \(\sin^{2}(\pi/4) = 1 - \tfrac12\) and \(\sin(\pi/4) > 0\) (Lemma 7.75) give the same value.
Periodicity. By Lemma 7.72 with \(y = 2\pi\), \(\cos(x + 2\pi) = \cos x\cos 2\pi - \sin x \sin 2\pi = \cos x\) and likewise \(\sin(x+2\pi) = \sin x\).
Sign of \(\sin\). On \((0,\pi/2]\), \(\sin > 0\) by Lemma 7.75. Reflection about \(\pi/2\) preserves the sine: by Equation (7.56) and the values just found, \(\sin(\pi - x) = \sin\pi\cos x - \cos\pi\sin x = \sin x\), so \(\sin > 0\) on \([\pi/2, \pi)\) as well, hence on all of \((0,\pi)\). Reflection about \(\pi\) reverses it: \(\sin(\pi + x) = -\sin x\), so \(\sin < 0\) on \((\pi, 2\pi)\).
Kernel. If \(\theta \in 2\pi\Z\) the values follow from periodicity and \(\cos 0 = 1\), \(\sin 0 = 0\). Conversely suppose \(\cos\theta = 1\) and \(\sin\theta = 0\); since \(\cos\) is even and \(\sin\) odd, assume \(\theta \ge 0\). Put \(m = \lfloor \theta/2\pi \rfloor\) (Lemma 7.65), an integer with \(m \ge 0\) and \(m \le \theta/2\pi < m+1\), and set \(\rho = \theta - 2\pi m\), so that \(\rho \in [0, 2\pi)\). Periodicity gives \(\cos\rho = 1\) and \(\sin\rho = 0\). If \(\rho \in (0,\pi)\) or \(\rho \in (\pi, 2\pi)\) then \(\sin\rho \neq 0\) by the sign statement; and \(\rho = \pi\) is excluded by \(\cos\pi = -1 \neq 1\). Hence \(\rho = 0\) and \(\theta = 2\pi m \in 2\pi\Z\).
∎Digits of $\pi$: the polygon recursion
Convergence establishes existence, not decimals; the distinction was drawn for \(\ee\) before Lemma 7.54 and applies here unchanged. Definition 7.74 produces \(\pi\) as an infimum and Proposition 7.76 identifies it geometrically, but neither yields one digit. What does is Archimedes' construction: bracket the circle between inscribed and circumscribed regular polygons and double their sides [Archimedes:1897]. Written for the perimeters, the doubling is a pair of means — one harmonic, one geometric — and the bracket tightens by a factor of four per step.
Three elementary inequalities are recorded first. The first pair is the analytic form of the statement that a chord is shorter and a tangent longer than the arc they span — read at half the central angle, since the chord subtending \(\theta\) has length \(2\sin(\theta/2)\) — and it is what makes the inscribed polygon a lower bound for \(\pi\) and the circumscribed one an upper. The third controls how fast the two close. All are proved from the derivatives already in hand, not from any geometric intuition about length.
For \(0 < \theta \le \pi/2\),
Rests on Lemma 7.71, Corollary 7.36 and Proposition 7.77.
Derives Lemma 7.78. On \((0,\pi/2]\) we have \(\sin > 0\) (Proposition 7.77), so \(-\cos\) has derivative \(\sin > 0\) on the interior and is therefore strictly increasing on \([0,\pi/2]\) (Corollary 7.36 applied to \(-\cos\); the corollary states the increasing case only). Hence \(\cos\theta < \cos 0 = 1\) for \(\theta \in (0,\pi/2]\).
Upper bound. Put \(h(\theta) = \theta - \sin\theta\). Then \(h(0) = 0\) and \(h' = 1 - \cos > 0\) on the interior, so \(h\) is strictly increasing and \(h > 0\), i.e. \(\sin\theta < \theta\).
Lower bound. Put \(g(\theta) = \sin\theta - \theta\cos\theta\). Then \(g(0) = 0\) and, by the product rule and Lemma 7.71,
on the interior, so \(g\) is strictly increasing and \(g > 0\), i.e. \(\theta\cos\theta < \sin\theta\).
Third inequality. Put \(k(\theta) = \theta^{2}/2 - 1 + \cos\theta\). Then \(k(0) = 0\) and \(k'(\theta) = \theta - \sin\theta > 0\) at every interior point, by the upper bound just proved, so \(k\) is strictly increasing and \(k > 0\) on \((0,\pi/2]\).
∎Define \(u_{1} = \sqrt{2}\), \(v_{1} = 2\) and, for \(n \ge 1\),
Then, writing \(\theta_{n} = \pi/2^{n+1}\),
and for every \(n \ge 1\)
so that \(2u_{n}\) and \(2v_{n}\) both converge to \(\pi\). Rests on Lemma 7.72, Lemma 7.78, Proposition 7.77 and Definition 7.74.
Derives Proposition 7.79. Closed form. At \(n=1\), \(\theta_{1} = \pi/4\) and \(\cos(\pi/4) = \sin(\pi/4) = 1/\sqrt{2}\) (Equation (7.62)). Hence \(2\sin\theta_{1} = \sqrt{2} = u_{1}\) and \(2\sin\theta_{1}/\cos\theta_{1} = 2 = v_{1}\), which is Equation (7.66) at \(n=1\).
Assume it at \(n\) and abbreviate \(\theta = \theta_{n}\), so \(\theta_{n+1} = \theta/2\). Writing \(c = \cos\theta\), the first recursion reads
using Equations (7.57) and (7.58) in the last two steps; this is \(v_{n+1}\). For the second,
whose positive square root is \(u_{n+1}\), since \(\sin(\theta/2) > 0\) (Proposition 7.77).
Bracket. With \(\theta_{n} = \pi/2^{n+1}\), so that \(2^{n+1} = \pi/\theta_{n}\),
the first because \(\sin\theta_{n} < \theta_{n}\) and the second because \(\theta_{n}\cos\theta_{n} < \sin\theta_{n}\) (Lemma 7.78, applicable since \(0 < \theta_{n} \le \pi/4\)).
Width. Subtracting, and using \(2u_{n} < \pi\) from the bracket just proved,
by the third inequality of Equation (7.64). For \(n \ge 1\), \(\theta_{n} \le \pi/4\), and \(\cos\) is strictly decreasing on \([0,\pi/2]\) (Lemma 7.75), so \(\cos\theta_{n} \ge \cos(\pi/4) = 1/\sqrt{2}\) (Equation (7.62)). Also \(\pi < 2v_{1} = 4\), again by the bracket. Hence
which is Equation (7.67). The width tends to \(0\), and the bracket forces both \(2u_{n}\) and \(2v_{n}\) to \(\pi\).
∎The construction is Archimedes' one, and the identification is worth making precisely, since the treatise has defined neither a regular polygon nor a tangent line. Take the \(m\) points \(P_{k} = (\cos(2\pi k/m), \sin(2\pi k/m))\), \(k = 0,\dots,m-1\), on the unit circle. By Lemma 7.72 and Lemma 7.71,
using Equation (7.58), so each of the \(m\) segments has length \(2\sin(\pi/m)\) and the closed polygon they form has perimeter \(2m\sin(\pi/m)\). Now scale by \(1/\cos(\pi/m)\) and rotate by half a step, i.e. take \(Q_{k} = \bigl(\cos\alpha_{k},\sin\alpha_{k}\bigr)/\cos(\pi/m)\) with \(\alpha_{k} = (2k+1)\pi/m\). The same computation gives its perimeter as \(2m\sin(\pi/m)/\cos(\pi/m)\). For the midpoint of \(Q_{k}Q_{k+1}\), write \(\alpha_{k} = s - d\) and \(\alpha_{k+1} = s + d\) with \(s = 2\pi(k+1)/m\) and \(d = \pi/m\); adding the two forms of Equation (7.55) and of Equation (7.56) gives \(\cos\alpha_{k} + \cos\alpha_{k+1} = 2\cos s\cos d\) and \(\sin\alpha_{k} + \sin\alpha_{k+1} = 2\sin s\cos d\), so
a point of the unit circle — indeed \(P_{k+1}\). Moreover \(\abs{Q_{k}} = \abs{Q_{k+1}} = 1/\cos(\pi/m)\), so the midpoint is the foot of the perpendicular from the origin to the line \(Q_{k}Q_{k+1}\), and every other point of that segment is strictly farther from the origin than \(1\). Each side of the second polygon therefore meets the circle in exactly one point, a vertex of the first, and lies outside it elsewhere — which is what circumscribed means. With \(m = 2^{n+1}\) the two half-perimeters are exactly \(2u_{n}\) and \(2v_{n}\) of Equation (7.66). Note that nothing in the proof above used this reading: the bracket and the width bound are inequalities between real numbers, and the polygons are what makes them memorable, not what makes them true. Rests on Proposition 7.79, Lemma 7.72 and Lemma 7.71.
Archimedes' construction (Proposition 7.79). The semiperimeters \(2u_{n}\) of the inscribed and \(2v_{n}\) of the circumscribed regular \(2^{n+1}\)-gon bracket \(\pi\), because on the first quadrant a chord is shorter and a tangent longer than the arc they span (Lemma 7.78). Doubling the number of sides is the pair of means Equation (7.65), and quarters the width of the bracket at every step; from the square (\(n=1\), width \(1.17\)) sixteen doublings reach the nine decimals of Corollary 7.81.
Rests on Proposition 7.79.
Derivation. Derives Corollary 7.81. Take \(n = 17\) in Equation (7.67). The width bound is \(12/4^{17} < 7\times 10^{-10}\), so nine decimals are available if the recursion itself is evaluated without loss. It can be: run Equation (7.65) in interval form on a fixed decimal grid, carrying for each of \(u_{n}\) and \(v_{n}\) a rational lower and upper bound and rounding every operation outward — each square root replaced, for the lower end, by the integer square root of the scaled radicand (the greatest integer whose square does not exceed it) and, for the upper end, by that integer plus one. This propagates because both maps of Equation (7.65) are increasing in each argument separately, so bounding the inputs outward bounds the outputs outward. Every step is then a finite sequence of exact integer operations, with no limit process and no rounding in the favourable direction, and the enclosure it returns is certain. At forty grid digits it gives
The endpoints agree in their first nine decimals, so every real number between them — \(\pi\) among them — begins \(3.141592653\).
∎Nothing about \(n = 17\) is special: each further doubling multiplies the width by \(1/4\) and so buys \(\log_{10}4 \approx 0.602\) of a decimal, and \(n = 26\) already certifies fourteen. What the method does not do, here as for \(\ee\), is terminate.
Proposition 7.79 doubles from the square, for convenience rather than necessity: \(\pi/4\) is the one angle reachable from \(\cos(\pi/2) = 0\) by a single half-angle step (Equation (7.62)), so the recursion starts with the shortest possible preliminary. A hexagon start is equally available — two applications of Lemma 7.72 give the triple-angle identity, which with \(\cos(\pi/2) = 0\) yields \(\cos(\pi/6) = \tfrac12\sqrt{3}\) — and it is what Archimedes used. He doubled from the hexagon instead, four times, reaching the regular \(96\)-gon, and bounded the perimeters by rational approximations to the surds he met; in Measurement of a Circle, Prop. 3, this yields
[Archimedes:1897], which pins two decimals. Two things about that achievement are easy to misstate. He did not compute a decimal expansion — the claim is a pair of rational bounds on a ratio of magnitudes, not a numeral — and the tract survives only in abridged form, so Equation (7.71) is what Prop. 3 supports and no more. Nor does he state an iteration scheme: he performs four specific doublings and bounds the surds he meets by rational estimates chosen stage by stage, and the uniform recursion Equation (7.65) is a modern reformulation. What is genuinely his is the idea the reformulation rests on — a bracket whose two sides are computed by the same construction and can be brought arbitrarily close by continuing it. Rests on Proposition 7.79.
Let \(c_{1} = \tfrac{1}{2}\sqrt{2}\) and \(c_{k+1} = \sqrt{(1+c_{k})/2}\). Then \(c_{k} = \cos(\pi/2^{k+1})\), the partial products satisfy
with \(u_{n}\) as in Proposition 7.79, and
Rests on Proposition 7.79, Lemma 7.72, Proposition 7.77 and Proposition 7.6.
Derives Proposition 7.83. The nested surds. \(c_{1} = \tfrac12\sqrt{2} = \cos(\pi/4)\) by Equation (7.62). If \(c_{k} = \cos(\pi/2^{k+1})\) then Equation (7.58) at \(x = \pi/2^{k+2}\) gives \(2\cos^{2}(\pi/2^{k+2}) = 1 + \cos(\pi/2^{k+1}) = 1 + c_{k}\), and the cosine is positive there, so \(\cos(\pi/2^{k+2}) = c_{k+1}\). Doubling the surd inside the square root at each step, \(c_{k} = \tfrac{1}{2}\sqrt{2 + \sqrt{2 + \cdots}}\) with \(k-1\) inner radicals, which is the sequence of factors in Equation (7.73).
Partial products. Iterating \(\sin\theta = 2\sin(\theta/2)\cos(\theta/2)\) (Equation (7.57)) \(n\) times from \(\theta = \pi/2\),
by Equation (7.66); this is Equation (7.72).
The limit. \(u_{n} \to \pi/2\) by Equation (7.67), and \(\pi/2 \neq 0\), so the partial products converge to \(2/\pi\) (Proposition 7.6).
∎Equation (7.72) is not a coincidence of two methods agreeing. Viète's product and Archimedes' doubling are the same computation written twice: the \(n\)-th partial product is \(1/u_{n}\), that is, twice the reciprocal of the inscribed semiperimeter \(2u_{n}\), so truncating the product after \(n\) factors is inscribing a \(2^{n+1}\)-gon. The error estimate Equation (7.67) proved for the polygons therefore transfers to the product on taking reciprocals, giving the same \(4^{-n}\) rate up to a bounded factor. Equation (7.73) is the first infinite product in mathematics [Viete:2000], published eighteen centuries after Equation (7.71); the identity above is the reason it converges at exactly the polygon's rate and not faster. Rests on Propositions 7.79 and 7.83.
Irrationality
The trailing dots of Equation (7.69) are a theorem, as they were for \(\ee\) in Proposition 7.56: no finite decimal, and no ratio of integers, equals \(\pi\). The proof below is Niven's, and what it needs from everything above is little: the two values \(\sin\pi = 0\) and \(\cos\pi = -1\) together with the positivity of \(\sin\) on \((0,\pi)\), all three from Proposition 7.77, and the derivatives and bound \(\abs{\sin} \le 1\) of Lemma 7.71.
\(\pi \notin \Q\). Consequently its decimal expansion neither terminates nor becomes periodic, and Equation (7.69) records the opening digits of an expansion that never ends. Rests on Proposition 7.77, Theorem 7.43, Lemma 7.71, Theorem 7.8, Proposition 7.48 and Lemma 7.86.
Derives Proposition 7.85. Suppose \(\pi = p/q\) with \(p, q\) positive integers. For an integer \(n \ge 1\) to be fixed later put
\(F(0)\) and \(F(\pi)\) are integers. Expanding the numerator of \(f\), \(f(x) = \frac{1}{n!}\sum_{i=n}^{2n}c_{i}x^{i}\) with every \(c_{i} \in \Z\), the sum starting at \(i = n\) because \(x^{n}\) divides the numerator. Hence \(f^{(k)}(0) = 0\) for \(k < n\) and for \(k > 2n\), while for \(n \le k \le 2n\) it is \(k!\,c_{k}/n!\), an integer because \(n!\) divides \(k!\). So every \(f^{(k)}(0)\) is an integer, and so is \(F(0)\). Moreover \(q\pi = p\) gives \(p - q(\pi - x) = qx\), so
whence \(f^{(k)}(\pi) = (-1)^{k}f^{(k)}(0) \in \Z\) and \(F(\pi) \in \Z\).
An integral that is a positive integer. Since \(f\) is a polynomial of degree \(2n\), \(f^{(2n+2)} = 0\) and therefore \(F + F'' = f\). Using \(\sin' = \cos\), \(\cos' = -\sin\) (Lemma 7.71),
so by the fundamental theorem of calculus (Theorem 7.43) and the values \(\sin\pi = 0\), \(\cos\pi = -1\), \(\sin 0 = 0\), \(\cos 0 = 1\) (Proposition 7.77),
On \((0,\pi)\) both factors are strictly positive — \(x > 0\) and \(p - qx = q(\pi - x) > 0\), so \(f > 0\), and \(\sin > 0\) by Proposition 7.77 — hence \(I_{n} > 0\).
The contradiction. On \([0,\pi]\) the product \(x(\pi - x)\) is at most \((\pi/2)^{2}\), attained at \(x = \pi/2\), so \(f(x) = q^{n}\bigl(x(\pi-x)\bigr)^{n}/n! \le q^{n}(\pi/2)^{2n}/n!\); with \(\sin \le 1\) and the interval of length \(\pi\),
The right side is \(\pi a^{n}/n!\) with \(a = q\pi^{2}/4\) fixed. The series \(\sum_{n}a^{n}/n!\) converges (ratio test, Proposition 7.48: consecutive terms are in the ratio \(a/(n+1) \to 0\)), and the terms of a convergent series tend to zero (Theorem 7.8 with \(M = N+1\)), so \(a^{n}/n! \to 0\). Choose \(n\) with \(\pi a^{n}/n! < 1\). Then \(I_{n}\) is an integer with \(0 < I_{n} < 1\), and no such integer exists. The assumption \(\pi \in \Q\) fails.
The statement about the decimal expansion is Lemma 7.86.
∎A real number whose decimal expansion terminates, or is eventually periodic, is rational. Equivalently, an irrational number's expansion neither terminates nor repeats. Rests on Proposition 7.46 and Definition 7.45.
Derives Lemma 7.86. A terminating expansion is a finite sum of terms \(d_{j}10^{-j}\), hence a ratio of integers. Suppose instead that after the first \(N\) digits following the point the expansion repeats a block of \(\ell\) digits forever, and let \(B\) be the integer those \(\ell\) digits spell. Split the number as the terminating part through the \(N\)-th place — rational, by the previous sentence — plus the tail. The \(j\)-th copy of the block occupies the places \(N+\ell j+1\) through \(N+\ell(j+1)\) and so contributes \(B\,10^{-(N+\ell(j+1))}\); summing over \(j \ge 0\),
by the geometric series (Proposition 7.46, ratio \(10^{-\ell}\in(0,1)\)), which is again a ratio of integers. A sum of two rationals is rational, and the contrapositive is the second sentence.
∎This is the fact Proposition 7.56 and Proposition 7.85 both need to turn irrationality into a statement about digits, and it is what makes the trailing dots of Equation (7.34) and Equation (7.69) theorems rather than typography.
Irrationality of \(\pi\) was first established by Lambert, in a memoir read to the Berlin Academy in 1761, by way of a continued-fraction expansion of the tangent [Lambert:1768]; the argument above is Niven's half-page replacement [Niven:1947], which needs no machinery beyond this chapter. Neither settles the stronger question. \(\pi\) is in fact transcendental — it satisfies no polynomial equation with rational coefficients [Lindemann:1882] — and that is what makes the classical construction of a square equal in area to a given circle impossible with straightedge and compass, since such constructions produce only algebraic numbers. Transcendence is not proved in this treatise and is not used by it; irrationality is, since it is what licenses the trailing dots in Equation (7.69) and in Physical Constants and SI Units. Rests on Proposition 7.85.
\(\pi\) was defined here analytically, as twice the first positive zero of \(\cos\) (Definition 7.74), and identified geometrically as the circle constant (Proposition 7.76). The facts that carry it into the rest of the book are the ones collected in Proposition 7.77, and it is worth naming which statement consumes which.
Euler's identity is immediate from them: combining \(\cos\pi = -1\) and \(\sin\pi = 0\) with Euler's formula (Proposition 8.4, proved there by splitting the same series used here) gives \(\ee^{\ii\pi} = -1\); and with that formula again, the kernel statement Equation (7.63) says that \(\ee^{\ii\theta} = 1\) precisely for \(\theta \in 2\pi\Z\) — that is, \(2\pi\) is exactly the period of \(\theta \mapsto \ee^{\ii\theta}\), and \(\pi\) is half of it. That periodicity is what the argument lift of Lemma 6.19 needs for its uniqueness clause, what makes \(\theta \mapsto a + r\ee^{\ii\theta}\) traverse a circle once on \([0,2\pi]\), and hence what puts the \(2\pi\ii\) into Lemma 8.11 and into every residue calculation descending from it. The addition theorems of Lemma 7.72 play the same role for Section 5.1.2, whose identities are derived there from Euler's formula and are available here without leaving the chapter.
Every subsequent appearance of \(\pi\) in this treatise — the \(2\pi\ii\) of the residue theorem, the phase-space volumes of statistical mechanics, the angles of Part III — is this one number, and its nine quoted decimals are Corollary 7.81. Rests on Proposition 7.77, Corollary 7.81 and Lemma 7.72.
Square roots, and the golden ratio
\(\ee\) and \(\pi\) were reached by infinite processes: a series and a bracket that never closes. The third named number of this treatise is of a different and much simpler kind — it is a root of \(x^{2} = x+1\) — and the machinery it needs is correspondingly smaller. What it shares with them is only that it is irrational, and that its irrationality does physical work.
Example 3.26 proved \(\sqrt{2}\notin\Q\) by a parity argument special to the prime \(2\). The general statement costs no more, and is proved here by descent rather than by unique factorisation, which this treatise has not developed.
Throughout, \(\sqrt{y}\) means \(y^{1/2}\) in the sense of Definition 7.62: it exists and is positive for \(y > 0\), and \(\sqrt{y}\,\sqrt{y} = y\) by the power laws (Equation (7.46)). No separate construction is needed.
Let \(n \in \N\). Then \(\sqrt{n} \in \Q\) if and only if \(n\) is a perfect square, in which case \(\sqrt{n} \in \N\). Rests on Lemma 7.65, Lemma 7.64, Definition 7.62 and Proposition 7.63.
Derives Proposition 7.89. If \(n = k^{2}\) with \(k \in \N\) then \(\sqrt{n} = k\) is rational. For the converse, suppose \(\sqrt{n}\) is rational but not an integer, and put
\(T\) is nonempty: writing the rational \(\sqrt{n} = p/q\) with \(q \in \N\) puts that \(q\) in \(T\). By Lemma 7.64 it has a least element, again called \(q\).
Put \(m = \lfloor\sqrt{n}\rfloor\) (Lemma 7.65) and \(q' = q\bigl(\sqrt{n}-m\bigr)\). Since \(q\sqrt{n}\) and \(qm\) are integers, \(q' \in \Z\); and \(\sqrt{n}\) is not an integer, so \(0 < \sqrt{n}-m < 1\) and therefore \(0 < q' < q\). A positive integer lies in \(\N\), so \(q' \in \N\). Finally
using \(\sqrt{n}\,\sqrt{n} = n\) (Equation (7.46)). So \(q' \in T\) and \(q' < q\), contradicting minimality. Hence a rational \(\sqrt{n}\) is an integer \(k\), and then \(n = k^{2}\).
∎Rests on Definition 7.62 and Proposition 7.63.
\(\varphi\) is the unique positive solution of
and
Moreover \(\varphi \notin \Q\), so its decimal expansion neither terminates nor repeats. Rests on Definition 7.90, Proposition 7.89, Lemma 7.86 and Proposition 7.63.
Derives Proposition 7.91. The equation. For any real \(x\), completing the square gives \(x^{2}-x-1 = \bigl(x-\tfrac12\bigr)^{2}-\tfrac54\), so Equation (7.77) holds exactly when \(\bigl(x-\tfrac12\bigr)^{2} = \tfrac54\), i.e. when \(x-\tfrac12 = \pm\tfrac12\sqrt{5}\) — the two square roots of \(5/4\), and no others, since \(u^{2}=v^{2}\) forces \(u=\pm v\). The root with the minus sign is \(\bigl(1-\sqrt{5}\bigr)/2 < 0\) because \(\sqrt{5} > 2 > 1\); the one with the plus sign is Equation (7.76) and is positive. So \(\varphi\) is the unique positive solution, and no appeal to continuity or monotonicity is needed.
Identities. \(\varphi^{2}=\varphi+1\) is Equation (7.77) at \(x=\varphi\); dividing it by \(\varphi>0\) gives \(\varphi = 1+1/\varphi\), which rearranges to \(1/\varphi = \varphi-1\).
Irrationality. \(5\) is not a perfect square, since \(2^{2}<5<3^{2}\), so \(\sqrt{5}\notin\Q\) (Proposition 7.89). If \(\varphi\) were rational then so would be \(2\varphi-1 = \sqrt{5}\), as \(\Q\) is closed under the field operations. Hence \(\varphi\notin\Q\), and the statement about its expansion is Lemma 7.86.
Digits. One integer square root settles them, by the discipline of Corollary 7.55 and Corollary 7.81. Let \(a\) be the greatest integer with \(a^{2} \le 5\cdot10^{20}\); squaring the two candidates shows \(a = 22360679774\), a finite computation in integers. Then \(a^{2} \le 5\cdot10^{20} < (a+1)^{2}\) gives \(a/10^{10} \le \sqrt{5} < (a+1)/10^{10}\), and halving after adding \(1\),
Every real number in that interval begins \(1.6180339887\), which is the ten decimals quoted in Equation (7.78).
∎Define \(c_{1} = 1\) and \(c_{k} = 1 + 1/c_{k-1}\) — the truncations of the continued fraction
Equation (7.80) being notation for exactly this recursion. Let \(F_{1}=F_{2}=1\) and \(F_{k+1}=F_{k}+F_{k-1}\). Then
Derives Proposition 7.92. The ratios. Write \(\rho_{k} = F_{k+1}/F_{k}\), so \(\rho_{1} = F_{2}/F_{1} = 1 = c_{1}\). Dividing the recurrence \(F_{k+1} = F_{k}+F_{k-1}\) by \(F_{k}\) gives \(\rho_{k} = 1 + F_{k-1}/F_{k} = 1 + 1/\rho_{k-1}\), the same recursion as the \(c_{k}\) with the same starting value; so \(c_{k} = \rho_{k}\) for every \(k\) by induction. Every \(F_{k} \ge 1\), so no division is by zero and every \(\rho_{k} \ge 1\).
Convergence. Subtract \(\varphi = 1+1/\varphi\) (Equation (7.78)) from \(\rho_{k} = 1+1/\rho_{k-1}\):
Every \(\rho_{k}\ge1\), and \(\varphi > 3/2\) by Equation (7.79), so \(\varphi\rho_{k-1} > 3/2\) and
whence \(\abs{\rho_{k}-\varphi} \le (2/3)^{k-1}\abs{\rho_{1}-\varphi} \longrightarrow 0\) (Proposition 7.6 and Proposition 7.46: a geometric factor with ratio in \((0,1)\) tends to \(0\)). The minus sign in the displayed identity also shows that \(\rho_{k}-\varphi\) alternates in sign, so consecutive truncations lie on opposite sides of \(\varphi\).
∎A non-zero real polynomial of degree \(n\) has at most \(n\) distinct real roots. Rests on Theorems 7.35 and 7.51.
Derives Lemma 7.93. By induction on \(n\). A non-zero polynomial of degree \(0\) is a non-zero constant and has no root. Suppose the claim holds at \(n-1\) and let \(p\) have degree \(n\) with distinct real roots \(\alpha_{1}<\cdots<\alpha_{N}\). A polynomial is differentiable, with \(p'\) of degree \(n-1\) and non-zero because the leading coefficient \(n a_{n} \neq 0\). On each \([\alpha_{j},\alpha_{j+1}]\) the mean value theorem (Theorem 7.35) gives a \(c_{j}\) in the open interval with \(p'(c_{j}) = \bigl(p(\alpha_{j+1})-p(\alpha_{j})\bigr)/ (\alpha_{j+1}-\alpha_{j}) = 0\). The \(N-1\) points \(c_{j}\) are distinct, lying in disjoint intervals, so \(p'\) has at least \(N-1\) distinct roots; by hypothesis \(N-1 \le n-1\), i.e. \(N \le n\).
∎A real number is algebraic if it is a root of some non-zero polynomial with integer coefficients, and transcendental otherwise; the least degree of such a polynomial is its degree. Rationals are the algebraic numbers of degree \(1\). \(\sqrt{2}\) and \(\varphi\) have degree exactly \(2\): each satisfies a quadratic (\(x^{2}-2\), \(x^{2}-x-1\)), and neither satisfies a linear one, since neither is rational (Example 3.26, Proposition 7.91). \(\ee\) and \(\pi\) satisfy no polynomial equation at all — they are transcendental [Lindemann:1882] [Hilbert:1893], a fact this treatise states and does not prove, and does not use except to record that squaring the circle is impossible (Remark 7.87).
So the three named numbers of this section fall on opposite sides of a real line. \(\varphi\) is the root of a quadratic and can be written with one square-root sign; \(\ee\) and \(\pi\) cannot be written in closed form at all, and each needed its own infinite process and its own irrationality proof. It would flatter \(\varphi\) to call it fundamental in the sense that those two are.
What makes the classification worth stating is that it is upside down with respect to counting. For each pair \((d,H)\) of naturals there are only finitely many integer polynomials of degree at most \(d\) with every coefficient at most \(H\) in absolute value, and Proposition 3.67 lists the pairs; laying the finite blocks end to end therefore lists every non-zero integer polynomial, say \(p_{1},p_{2},\dots\). Each \(p_{i}\) has at most \(\deg p_{i}\) real roots (Lemma 7.93), so listing the roots of \(p_{1}\), then those of \(p_{2}\), and so on, exhausts the algebraic numbers in a sequence. They are therefore countable, hence a null set (Lemma 7.139), while \(\R\) is not countable at all (Theorem 3.69).
Almost every real number is transcendental — in the measure sense, the exceptions occupying a set of measure zero — and yet the transcendentals anyone can name fit on one line. The named constants are the rare cases, not the typical ones, and \(\varphi\) is not even among the rare ones: it is one of the countably many roots of integer polynomials, distinguished only by which polynomial. Rests on Proposition 7.91, Proposition 7.85, Proposition 7.56, Theorem 3.69, Proposition 3.67, Corollary 3.68 and Lemma 7.139.
\(\varphi\) earns its place in a physics treatise at two points, and both turn on its irrationality rather than on its value.
The first is the crystallographic restriction. A rotation carrying a lattice to itself has an integer matrix in a lattice basis, so its trace is an integer; that trace is \(2\cos\theta\) in the plane, and \(2\cos(2\pi/5) = 1/\varphi\) is irrational, so no lattice admits a five-fold axis (Proposition 125.2). That is what makes the sharp five-fold diffraction reported in Phenomenon 125.1 incompatible with periodicity.
The second is the breakdown of invariant tori. Proposition 32.55 records that the last curve of the standard map to survive is the one whose winding number is the golden mean, because it is the worst approximable by rationals — and that is a statement about Equation (7.80), whose partial quotients are all \(1\), the slowest possible convergence of the truncations in Proposition 7.92.
Claims that \(\varphi\) governs growth or proportion more widely are outside what this treatise admits as evidence. Rests on Propositions 7.91 and 7.92.
Multivariable calculus
Planes in $\R^{3}$
Let \(\vect{n}=(a,b,c)\neq\vect{0}\), \(\vect{p}_0=(x_0,y_0,z_0)\), and \(\vect{p}=(x,y,z)\). A plane is the set of points \(\vect{p}\) satisfying
where \(\vect{n}\cdot\vect{p}_0\) is a real constant. Rests on Definition 5.18.
Differentiable functions
Let \(\vect{F}:A\subseteq\R^{m}\longrightarrow\R^{n}\) be a function, with \(\vect{x}=(x_1,\ldots,x_m)\), \(\vect{F}=(F_1(\vect{x}),\ldots,F_n(\vect{x}))\), and \(A\) an open set.
The \(k\)-th partial derivative of a scalar function \(f:A\subseteq\R^{m}\longrightarrow\R\) at \(\vect{a}\in A\) is the ordinary derivative of the one-variable function obtained by freezing every coordinate but the \(k\)-th,
where \(\vect{e}_k\) is the \(k\)-th vector of the canonical basis of \(\R^{m}\). The gradient \(\nabla f(\vect{a})=\left(\pp_1 f(\vect{a}),\ldots, \pp_m f(\vect{a})\right)\) collects the \(m\) of them. Rests on Definitions 5.15 and 7.26.
We say that \(\vect{F}\) is \(C^{1}\) on \(A\) if and only if the \(m\) first-order partial derivatives of each of its \(n\) components have domain \(A\) and are continuous on \(A\). Rests on Definitions 7.20 and 7.97.
\(\vect{F}\) is differentiable at \(\vect{a}\in A\) if and only if there is a linear map \(L:\R^{m}\longrightarrow\R^{n}\) such that
the bars denoting Euclidean length (Equation (6.12)). Such an \(L\) is unique: if \(L\) and \(L'\) both satisfy Equation (7.84), subtracting gives \(\abs{(L-L')(\vect{h})}/\abs{\vect{h}}\longrightarrow 0\), and taking \(\vect{h}=t\,\vect{u}\) with \(\abs{\vect{u}}=1\) and \(t\longrightarrow 0\) leaves \((L-L')(\vect{u})=\vect{0}\) for every unit vector, so \(L=L'\). The same substitution also identifies \(L\): taking \(\vect{h}=t\,\vect{e}_k\) in Equation (7.84) and letting \(t\longrightarrow 0\) gives \(\left(\vect{F}(\vect{a}+t\,\vect{e}_k)-\vect{F}(\vect{a})\right)/t \longrightarrow L(\vect{e}_k)\), so each partial derivative \(\pp_k F_j(\vect{a})\) exists (Definition 7.97) and \(L(\vect{e}_k)\) is the vector of the \(n\) of them. The matrix of \(L\) in the canonical bases is therefore \(\left(\pp_k F_j(\vect{a})\right)\), whose \(j\)-th row is the gradient \(\nabla F_j(\vect{a})\). Note what this does and does not say: differentiability at a single point already forces the partial derivatives to exist and to assemble into the differential, with nothing assumed about their continuity — but the converse fails, as Remark 7.101 shows. Rests on Definition 5.37, Definition 7.16 and Equation (6.12).
Let \(A\subseteq\R^{m}\) be open and let \(\vect{F}:A\longrightarrow\R^{n}\) be of class \(C^{1}\). Then \(\vect{F}\) is differentiable at every \(\vect{a}\in A\), and its differential is the linear map
that is, the differential of Definition 7.102 below. Rests on Definition 7.98, Definition 7.99 and Theorem 7.35.
Derives Theorem 7.100. Reduction to one component. With \(L\) as in Equation (7.85), the \(j\)-th component of \(\vect{F}(\vect{a}+\vect{h})-\vect{F}(\vect{a})-L(\vect{h})\) is \(R_j(\vect{h})=F_j(\vect{a}+\vect{h})-F_j(\vect{a}) -\nabla F_j(\vect{a})\cdot\vect{h}\), and the Euclidean length of a vector is at most the sum of the absolute values of its components. It therefore suffices to prove that \(\abs{R_j(\vect{h})}/\abs{\vect{h}}\longrightarrow 0\) for a single scalar \(C^{1}\) function \(f=F_j\).
A staircase of coordinate steps. Since \(A\) is open, fix \(r>0\) with \(B_r(\vect{a})\subseteq A\) (Definition 6.26) and let \(\abs{\vect{h}}<r\). Put \(\vect{p}_0=\vect{a}\) and
so that \(\vect{p}_m=\vect{a}+\vect{h}\). Every point of the segment joining \(\vect{p}_{k-1}\) to \(\vect{p}_k\) has the form \(\vect{a}+\sum_{i<k}h_i\vect{e}_i+t\,h_k\vect{e}_k\) with \(t\in[0,1]\), and its distance to \(\vect{a}\) is at most \(\abs{\vect{h}}<r\): the whole staircase lies inside \(B_r(\vect{a})\). Telescoping,
The mean value theorem on each step. The \(k\)-th bracket moves only the \(k\)-th coordinate, so it is the increment over \([0,1]\) of the one-variable function \(g_k(t)=f(\vect{p}_{k-1}+t\,h_k\vect{e}_k)\). Assume \(h_k\neq 0\). The difference quotient of \(g_k\) at \(t\) with increment \(s\) becomes, on substituting \(u=s\,h_k\), exactly \(h_k\) times the quotient appearing in Equation (7.83), so \(g_k'(t)=h_k\,\pp_k f(\vect{p}_{k-1}+t\,h_k\vect{e}_k)\) wherever the partial derivative \(\pp_k f\) exists — that is, throughout \(B_r(\vect{a})\). Both endpoints of the segment lie at distance \(\abs{\vect{h}}<r\) from \(\vect{a}\), hence in the interior of the ball, so \(g_k\) is defined and differentiable on an open interval containing \([0,1]\) and is in particular continuous there (Proposition 7.27). By Theorem 7.35 there is \(\theta_k\in(0,1)\) with
and \(\abs{\vect{\xi}_k-\vect{a}}\le\abs{\vect{h}}\). If \(h_k=0\) both sides of Equation (7.87) vanish and \(\vect{\xi}_k=\vect{p}_{k-1}\) serves.
The estimate. Subtracting \(\nabla f(\vect{a})\cdot\vect{h}=\sum_{k}h_k\,\pp_k f(\vect{a})\) from Equation (7.86) and inserting Equation (7.87),
so that, since \(\abs{h_k}\le\abs{\vect{h}}\) for every \(k\),
Given \(\varepsilon>0\), continuity of the \(m\) partial derivatives at \(\vect{a}\) (Definition 7.98) provides \(\delta\in(0,r)\) such that \(\abs{\vect{y}-\vect{a}}<\delta\) implies \(\abs{\pp_k f(\vect{y})-\pp_k f(\vect{a})}<\varepsilon/m\) for every \(k\). For \(\abs{\vect{h}}<\delta\) each \(\vect{\xi}_k\) obeys \(\abs{\vect{\xi}_k-\vect{a}}\le\abs{\vect{h}}<\delta\), so the right-hand side of Equation (7.88) is smaller than \(\varepsilon\). This is Equation (7.84).
∎Continuity of the partial derivatives is doing real work in Theorem 7.100: their bare existence does not even force continuity of the function, let alone differentiability. The standard witness on \(\R^{2}\) is
Both partial derivatives exist at the origin and vanish there, because \(f\) vanishes identically on each axis; yet \(f(x,x)=1/2\) for every \(x\neq 0\), so \(f\) has no limit at the origin and is discontinuous there. The partial derivatives of this \(f\) are accordingly not continuous at the origin, and the hypothesis of Theorem 7.100 fails. Rests on Theorem 7.100 and Definition 7.20.
We say that the linear map
is the differential of \(\vect{F}\) at \(\vect{a}\in A\) if and only if \(\vect{F}\) is differentiable at \(\vect{a}\). The two prescriptions agree whenever they apply at all: if \(\vect{F}\) is differentiable at \(\vect{a}\) then the unique linear map of Definition 7.99 has exactly the matrix written here, as identified there — differentiability alone, with no continuity assumed of the partial derivatives. Theorem 7.100 adds that such a map exists whenever \(\vect{F}\) is \(C^{1}\). Rests on Definitions 7.97 and 7.99.
If \(n=1\), one has
Rests on Definition 7.102.
Let \(A\subseteq\R^{m}\) and \(B\subseteq\R^{p}\) be open, let \(\vect{G}:A\longrightarrow B\) be differentiable at \(\vect{a}\in A\), and let \(\vect{F}:B\longrightarrow\R^{n}\) be differentiable at \(\vect{b}=\vect{G}(\vect{a})\). Then \(\vect{F}\circ\vect{G}\) is differentiable at \(\vect{a}\), with differential the composite \(\dd\vect{F}(\vect{b})\circ\dd\vect{G}(\vect{a})\); in components,
Derives Proposition 7.104. Write \(L=\dd\vect{G}(\vect{a})\) and \(M=\dd\vect{F}(\vect{b})\). A linear map between Euclidean spaces is bounded: expanding in the canonical bases and applying the Cauchy–Schwarz inequality (Linear Algebra and Representation Theory) row by row produces constants \(C_L\), \(C_M\) with \(\abs{L\vect{v}}\le C_L\abs{\vect{v}}\) and \(\abs{M\vect{w}}\le C_M\abs{\vect{w}}\). By Definition 7.99,
where \(\abs{\vect{\rho}(\vect{h})}/\abs{\vect{h}}\longrightarrow 0\), and where \(\abs{\vect{\sigma}(\vect{k})} =\varepsilon(\vect{k})\,\abs{\vect{k}}\) with \(\varepsilon(\vect{k})\longrightarrow 0\) as \(\vect{k}\longrightarrow\vect{0}\); setting \(\varepsilon(\vect{0})=0\) is consistent, since \(\vect{\sigma}(\vect{0})=\vect{0}\). Put \(\vect{k}(\vect{h})=L\vect{h}+\vect{\rho}(\vect{h})\), so that
The first remainder obeys \(\abs{M\vect{\rho}(\vect{h})}\le C_M\abs{\vect{\rho}(\vect{h})}\) and is therefore \(o(\abs{\vect{h}})\). For the second, taking \(\abs{\vect{h}}\) small enough that \(\abs{\vect{\rho}(\vect{h})}\le\abs{\vect{h}}\) gives \(\abs{\vect{k}(\vect{h})}\le\left(C_L+1\right)\abs{\vect{h}}\), whence
and \(\vect{k}(\vect{h})\longrightarrow\vect{0}\) with \(\vect{h}\), so this remainder is \(o(\abs{\vect{h}})\) as well. Hence \(ML\) satisfies Equation (7.84) for \(\vect{F}\circ\vect{G}\) and is its differential, by the uniqueness established in Definition 7.99. Reading off the matrix of \(ML\) in the canonical bases, the rows of \(L\) and of \(M\) being the gradients of the components — which mere differentiability already secures, by the identification in Definition 7.99 — is Equation (7.91).
∎If \(f : A \subseteq \R^2 \longrightarrow \R\) has continuous second partial derivatives, then \(\pp_x \pp_y f = \pp_y \pp_x f\). Rests on Theorem 7.35 and Definition 7.20.
Derives Proposition 7.105. Fix \((x,y)\) and consider the second difference \(\Delta(h,k) = f(x+h, y+k) - f(x+h,y) - f(x,y+k) + f(x,y)\). Applying the mean value theorem (Theorem 7.35) in \(x\) to \(u(t) = f(t, y+k) - f(t, y)\) gives \(\Delta = \left[\pp_x f(\xi, y+k) - \pp_x f(\xi, y)\right] h\) for some \(\xi\), and a second application in \(y\) gives \(\Delta = \pp_y \pp_x f(\xi, \eta)\, h k\). Symmetrically, \(\Delta = \pp_x \pp_y f(\xi', \eta')\, h k\). Dividing by \(hk\) and letting \((h,k) \to 0\), continuity of the second partials forces \(\pp_y \pp_x f(x,y) = \pp_x \pp_y f(x,y)\).
∎Taylor expansion in several variables
Let \(A\subseteq\R^{m}\) be open, let \(f:A\longrightarrow\R\) have continuous second partial derivatives on \(A\), let \(\vect{a}\in A\), and let \(\vect{h}\in\R^{m}\) be small enough that the whole segment \(\set{\vect{a}+t\vect{h}\mid t\in[0,1]}\) lies in \(A\). Write
for the Hessian of \(f\), a symmetric matrix by Proposition 7.105. Then there is \(\theta\in(0,1)\) with
and consequently, as \(\vect{h}\longrightarrow\vect{0}\),
Rests on Theorem 7.38, Proposition 7.104 and Proposition 7.105.
Derives Theorem 7.106. Since \(A\) is open and the segment is compact, there is \(\varepsilon>0\) with \(\vect{a}+t\vect{h}\in A\) for every \(t\in(-\varepsilon,1+\varepsilon)\); put \(g(t)=f(\vect{a}+t\vect{h})\) there. The map \(t\longmapsto\vect{a}+t\vect{h}\) is differentiable with differential \(\vect{h}\), so the chain rule Equation (7.91) gives
the second by applying the same rule to each \(\pp_i f\), which is \(C^{1}\) by hypothesis. Hence \(g\) is twice differentiable on an interval containing \([0,1]\), and Theorem 7.38 at order \(n=1\) supplies \(\theta\in(0,1)\) with \(g(1)=g(0)+g'(0)+\tfrac{1}{2}g''(\theta)\), which is Equation (7.93).
For Equation (7.94), subtract the two quadratic terms: the difference is
whose modulus is at most \(\tfrac{1}{2}\abs{\vect{h}}^{2}\sum_{i,j} \abs{H_{ij}(\vect{a}+\theta\vect{h})-H_{ij}(\vect{a})}\), since \(\abs{h_i}\le\abs{\vect{h}}\) for every \(i\). As \(\vect{h}\longrightarrow\vect{0}\) the point \(\vect{a}+\theta\vect{h}\) tends to \(\vect{a}\) whatever value \(\theta\in(0,1)\) takes, so continuity of the second partial derivatives sends that sum to zero. The difference is therefore \(o(\abs{\vect{h}}^{2})\).
∎Equation (7.94) is the statement behind every expansion of a potential about an equilibrium: at a stationary point \(\nabla f(\vect{a})=\vect{0}\) the leading behaviour is the quadratic form \(\vect{h}\transpose H(\vect{a})\vect{h}\), whose signature (Theorem 5.116) decides whether the point is a minimum, a maximum or a saddle, and whose symmetry — Proposition 7.105, not a modelling assumption — is what allows it to be diagonalized by an orthogonal change of axes. Rests on Theorems 5.116 and 7.106.
Let \(U\subseteq\R^{n}\) be open and a cone, meaning that \(\mu\vect{u}\in U\) whenever \(\vect{u}\in U\) and \(\mu>0\), and let \(f:U\longrightarrow\R\) be differentiable. Then \(f\) is homogeneous of degree \(k\),
if and only if
at every \(\vect{u}\in U\). Rests on Proposition 7.104, Corollary 7.36 and Proposition 7.30.
Derives Proposition 7.108. Fix \(\vect{u}\in U\). Because \(U\) is a cone, \(\mu\longmapsto f(\mu\vect{u})\) is defined for every \(\mu>0\), and the chain rule Equation (7.91) makes it differentiable with
If Equation (7.96) holds, differentiate it in \(\mu\): the left-hand side is Equation (7.98) and the right-hand side is \(k\mu^{k-1}f(\vect{u})\). Setting \(\mu=1\) leaves Equation (7.97).
Conversely, assume Equation (7.97) throughout \(U\) and put \(\psi(\mu)=\mu^{-k}f(\mu\vect{u})\) for \(\mu>0\). By the product rule (Proposition 7.30) and Equation (7.98),
the bracket vanishing because Equation (7.97) holds at the point \(\mu\vect{u}\in U\). A function with vanishing derivative on an interval is constant (Corollary 7.36), so \(\psi(\mu)=\psi(1)=f(\vect{u})\) for every \(\mu>0\), which is Equation (7.96).
∎Differentiation under the integral sign
An integral over a fixed region, of an integrand carrying a parameter, is a function of that parameter, and the question when it may be differentiated by differentiating the integrand is answered by the mean value theorem and uniform continuity alone. The statement is placed here, beside the chain rule, because that is what it is used with; the multiple integral it is written for is Definition 7.125 below, and the one-dimensional case is contained in it as \(N=1\).
Let \(D\subset\R^{N}\) be a compact region that decomposes into finitely many simple regions (Definition 7.127), of volume \(V=\int_{D}1\); let \(I\subseteq\R\) be an open interval; and let \(f:D\times I\longrightarrow\R\) be continuous with continuous partial derivative \(\pp f/\pp t\) on \(D\times I\). Then \(F(t)=\int_{D}f(\vect{x},t)\,\dd V\) is differentiable on \(I\) and
the right-hand side being itself continuous in \(t\). Rests on Definition 7.125, Theorem 7.25 and Theorem 7.35.
Derives Theorem 7.109. Fix \(t\in I\) and choose \(\eta>0\) with \(J=[t-\eta,t+\eta]\subset I\). The set \(D\times J\) is closed and bounded in \(\R^{N+1}\), hence compact (Theorem 6.12), so \(\pp f/\pp t\) is uniformly continuous on it (Theorem 7.25). Both \(f(\cdot,s)\) and \(\pp_t f(\cdot,s)\) are continuous on \(D\), hence integrable there (Remark 7.128); write \(G(t)=\int_{D}\pp_t f(\vect{x},t)\,\dd V\).
Let \(0<\abs{h}\le\eta\). For each fixed \(\vect{x}\in D\) the one-variable function \(s\longmapsto f(\vect{x},s)\) is differentiable on \(J\), so the mean value theorem (Theorem 7.35) supplies \(\theta=\theta(\vect{x},h)\in(0,1)\) with
Subtracting \(\pp_t f(\vect{x},t)\), integrating over \(D\) and bounding the integral of a function by the volume times its supremum,
Given \(\varepsilon>0\), uniform continuity provides \(\delta\in(0,\eta]\) such that \(\abs{s-s'}<\delta\) implies \(\abs{\pp_t f(\vect{x},s)-\pp_t f(\vect{x},s')}<\varepsilon/(V+1)\) for every \(\vect{x}\in D\). Since \(\abs{(t+\theta h)-t}\le\abs{h}\), taking \(\abs{h}<\delta\) makes the right-hand side of Equation (7.101) smaller than \(\varepsilon\); this is Equation (7.99). The same bound with \(t+\theta h\) replaced by an arbitrary \(t'\in J\) gives \(\abs{G(t)-G(t')}\le V\sup_{D}\abs{\pp_t f(\cdot,t) -\pp_t f(\cdot,t')}\), so \(G\) is continuous.
∎Let \(f\) and \(\pp f/\pp t\) be continuous on \([c,d]\times I\) and let \(\alpha,\beta:I\longrightarrow[c,d]\) be of class \(C^{1}\). Then
Rests on Theorem 7.109, Theorem 7.42 and Proposition 7.104.
Derives Corollary 7.110. Put \(\Phi(u,v,t)=\int_{u}^{v}f(x,t)\,\dd x\) on \([c,d]\times[c,d]\times I\). The fundamental theorem of calculus (Theorem 7.42), together with the sign rule for exchanging the limits of integration, gives \(\pp_v\Phi=f(v,t)\) and \(\pp_u\Phi=-f(u,t)\); Theorem 7.109 applied on the interval with endpoints \(u\) and \(v\) gives \(\pp_t\Phi=\int_{u}^{v}\pp_t f(x,t)\,\dd x\). All three are continuous in \((u,v,t)\): the first two because \(f\) is, the third by the last clause of Theorem 7.109 together with the estimate \(\abs{\int_{u}^{v}g-\int_{u'}^{v'}g} \le\left(\abs{u-u'}+\abs{v-v'}\right)\sup\abs{g}\) applied to \(g=\pp_t f\). Hence \(\Phi\) is \(C^{1}\) and therefore differentiable (Theorem 7.100), and the chain rule Equation (7.91) applied to \(t\longmapsto\Phi\left(\alpha(t),\beta(t),t\right)\) is Equation (7.102).
∎The derivative of a determinant has already appeared, in Proposition 5.2 of Linear Algebra and Representation Theory, differentiated a column at a time — the form wanted when the columns are the objects that move. The same derivative resolved into the \(n^{2}\) individual entries is the form wanted when the entries are, and it is what the change-of-variables and Liouville arguments below use. The two are the same identity: expand each differentiated column of the column form along that column and its cofactors, which contain no entry of it, and the column sum becomes the entry sum term for term.
Let \(I\subseteq\R\) be an open interval and let \(A:I\longrightarrow \R^{n\times n}\) be a differentiable matrix-valued function, with entries \(A^{i}{}_{j}(t)\). Then \(t\longmapsto\det A(t)\) is differentiable and
\(C^{i}{}_{j}\) being the cofactor of the entry \(A^{i}{}_{j}\). Wherever \(A(t)\) is invertible this reads
and where moreover \(\det A>0\), \(\dd\left(\ln\det A\right)/\dd t =\tr\left(A^{-1}\dd A/\dd t\right)\). Rests on Proposition 5.2, Equation (5.19), Proposition 7.30 and Proposition 7.31.
Derives Proposition 7.111. The cofactor form. By Equation (5.19) the determinant is a polynomial in the \(n^{2}\) entries, and each of its terms carries exactly one entry from each column. Differentiating that sum of products by the product rule (Proposition 7.30),
Collecting the terms that multiply one fixed \(\dd A^{i}{}_{j}/\dd t\) leaves precisely the coefficient of \(A^{i}{}_{j}\) in Equation (5.19), that is \(\pp\det A/\pp A^{i}{}_{j}=C^{i}{}_{j}\), which is Equation (7.103). Note that \(C^{i}{}_{j}\) contains no entry of the \(j\)-th column at all.
The trace form. Since \(\det\) is linear in the \(j\)-th column and \(C^{i}{}_{j}\) is free of that column, expanding along it gives \(\sum_{i}A^{i}{}_{j}C^{i}{}_{j}=\det A\) for each \(j\); and for \(k\neq j\) the sum \(\sum_{i}A^{i}{}_{k}C^{i}{}_{j}\) is that same expansion for the matrix whose \(j\)-th column has been replaced by its \(k\)-th, a matrix with two equal columns, whose determinant therefore vanishes. These are the two properties of Equation (5.19) on which Equation (5.16) also rests, and together they say
If \(\det A\neq0\), Equation (7.105) states that the matrix with entries \(C^{i}{}_{j}/\det A\), read with its indices exchanged, is a left inverse of \(A\) and hence its inverse: \(\left(A^{-1}\right)^{j}{}_{i}=C^{i}{}_{j}/\det A\). Substituting in Equation (7.103),
because the \(j\)-th diagonal entry of \(A^{-1}\dd A/\dd t\) is \(\sum_{i}\left(A^{-1}\right)^{j}{}_{i}\dd A^{i}{}_{j}/\dd t\). This is Equation (7.104), and the logarithmic form follows from it by the chain rule (Proposition 7.31).
∎The implicit function theorem
Let \(A\subseteq\R^{m}\times\R^{n}\) be open, let \(\vect{F}:A\longrightarrow\R^{n}\) be of class \(C^{k}\) with \(k\ge1\), write the points of \(A\) as \((\vect{x},\vect{y})\) with \(\vect{x}\in\R^{m}\) and \(\vect{y}\in\R^{n}\), and abbreviate \(\left(D_{\vect{y}}\vect{F}\right)_{ij}=\pp F_i/\pp y_j\) and \(\left(D_{\vect{x}}\vect{F}\right)_{ij}=\pp F_i/\pp x_j\). Let \((\vect{a},\vect{b})\in A\) satisfy
Then there are open sets \(W\ni\vect{a}\) in \(\R^{m}\) and \(V\ni\vect{b}\) in \(\R^{n}\) with \(W\times V\subseteq A\), and a unique map \(\vect{h}:W\longrightarrow V\) whose graph is the zero set,
with \(\vect{h}(\vect{a})=\vect{b}\). That map is of class \(C^{k}\), and
both blocks being evaluated at \(\left(\vect{x},\vect{h}(\vect{x})\right)\). Rests on Theorem 7.100, Proposition 7.104 and Definition 7.99.
Full derivation in Appendix A.
Derives Theorem 7.112.
Let \(U\subseteq\R^{n}\) be open, let \(\vect{f}:U\longrightarrow\R^{n}\) be of class \(C^{k}\) with \(k\ge1\), and let \(\vect{\alpha}\in U\) satisfy \(\det\left[D\vect{f}(\vect{\alpha})\right]\neq0\). Then \(\vect{f}\) maps some open \(U_{0}\ni\vect{\alpha}\) bijectively onto an open \(V_{0}\ni\vect{f}(\vect{\alpha})\); the inverse \(\vect{g}:V_{0}\longrightarrow U_{0}\) is of class \(C^{k}\); and
A \(C^{k}\) map whose derivative is everywhere invertible is therefore a local \(C^{k}\) diffeomorphism: a bijection between open sets with \(C^{k}\) inverse. Rests on Theorem 7.112, Definition 7.98 and Proposition 7.104.
Full derivation in Appendix A.
Derives Corollary 7.113.
Both statements are proved in The Implicit Function Theorem, as Theorem A.286 and Corollary A.292, from exactly the material of Section 7.10.2 and nothing else: no fixed-point theorem is imported, the Newton iteration being run explicitly and its convergence read off the Cauchy criterion (Theorem 7.8). The proof runs to several pages and would unbalance this chapter, which is why it sits in the appendix. The statements belong here, because this is where several-variable differentiability is developed and because what uses them — the constant-rank theorem and the multiplier rule below, the regular value theorem of Differentiable Manifolds, Tensors, and Curvature, the inversion of a Legendre transformation in Calculus of Variations — reaches for them as calculus, not as geometry. Rests on Theorem 7.112 and Corollary 7.113.
Let \(U\subseteq\R^{N}\) be open, let \(\vect{F}:U\longrightarrow\R^{N'}\) be of class \(C^{k}\) with \(k\ge1\), and suppose the derivative \(D\vect{F}\) has one and the same rank \(r\) at every point of \(U\). Then about each \(\vect{p}\in U\) and about its image there are \(C^{k}\) diffeomorphisms (Corollary 7.113) \(\varphi\), of a neighbourhood of \(\vect{p}\) onto a neighbourhood of the origin of \(\R^{N}\), and \(\chi\), of a neighbourhood of \(\vect{F}(\vect{p})\) onto a neighbourhood of the origin of \(\R^{N'}\), in which \(\vect{F}\) reads
In particular the image of a small enough neighbourhood of \(\vect{p}\) is, in the coordinates \(\chi\), the intersection of an \(r\)-dimensional coordinate plane with an open set, cut out by the vanishing of \(N'-r\) coordinate functions with independent differentials. Rests on Corollary 7.113, Proposition 7.104 and Corollary 7.36.
Derives Theorem 7.115. Replacing \(\vect{F}\) by \(\vect{F}-\vect{F}(\vect{p})\) — a translation of the target, which changes neither \(D\vect{F}\) nor its rank — we may assume \(\vect{F}(\vect{p})=\vect{0}\).
Straightening the source. Since \(D\vect{F}(\vect{p})\) has rank \(r\), some \(r\times r\) minor of it is non-zero; relabelling the coordinates of \(\R^{N}\) and of \(\R^{N'}\), which are linear changes and hence \(C^{\infty}\), we may take it to be the minor built from the first \(r\) rows and the first \(r\) columns. Define
Its derivative at \(\vect{p}\) is block triangular, carrying that invertible \(r\times r\) minor in the upper left and the identity in the lower right, so \(\det D\varphi(\vect{p})\neq0\) and Corollary 7.113 makes \(\varphi\) a \(C^{k}\) diffeomorphism of a neighbourhood of \(\vect{p}\) onto a neighbourhood of \(\varphi(\vect{p})=\vect{0}\). Shrink the latter to an open box \(B=B'\times B''\) with \(B'\subseteq\R^{r}\) and \(B''\subseteq\R^{N-r}\), and shrink the former to its preimage.
The tail depends only on the head. Put \(\vect{G}=\vect{F}\circ\varphi^{-1}\) on \(B\), of class \(C^{k}\). By construction the first \(r\) components of \(\vect{G}\) are the first \(r\) coordinates, so
and the derivative has the block form
The chain rule Equation (7.91) gives \(D\vect{G}=D\vect{F}\cdot D\varphi^{-1}\) with \(D\varphi^{-1}\) invertible, so \(D\vect{G}\) has rank \(r\) at every point of \(B\). Its first \(r\) columns are already independent by Equation (7.113), so every column of \(D_{\vect{v}''}\vect{g}\) must be a combination of them; but those columns vanish in the first \(r\) rows, so each is a combination with zero coefficients, that is \(D_{\vect{v}''}\vect{g}\equiv0\) on \(B\). Because \(B''\) is a box, any two of its points are joined inside \(B\) by a chain of coordinate steps, along each of which \(\vect{g}\) is constant (Corollary 7.36); hence \(\vect{g}\) does not depend on \(\vect{v}''\), and we write \(\vect{g}=\vect{g}(\vect{v}')\).
Straightening the target. On \(B'\times\R^{N'-r}\) define
It is \(C^{k}\), and it is a bijection of \(B'\times\R^{N'-r}\) onto itself with the \(C^{k}\) inverse \(\left(\vect{w}',\vect{w}''\right)\longmapsto \left(\vect{w}',\vect{w}''+\vect{g}(\vect{w}')\right)\), hence a \(C^{k}\) diffeomorphism. Composing with Equation (7.112),
which is Equation (7.110). The final clause is that statement read backwards: in the coordinates \(\chi\) the image is where the last \(N'-r\) coordinates vanish.
∎Let \(A\subseteq\R^{n}\) be open, let \(\phi_1,\ldots,\phi_J:A\longrightarrow\R\) be smooth with linearly independent gradients at every point of their common zero set
and let \(f\) be smooth on \(A\) and vanish identically on \(\Sigma\). Then every point of \(\Sigma\) has a neighbourhood on which
for smooth functions \(c^{1},\ldots,c^{J}\). Rests on Corollary 7.113, Theorem 7.43 and Theorem 7.109.
Derives Lemma 7.116. Adapted coordinates. Fix \(\vect{p}\in\Sigma\). The \(J\times n\) matrix of the gradients \(\nabla\phi_j(\vect{p})\) has rank \(J\), so \(J\) of its columns are independent; relabelling the coordinates, take them to be the first \(J\). Let \(i_1<\cdots<i_{n-J}\) be the remaining indices and put
Expanding \(\det D\vect{\Psi}(\vect{p})\) along its last \(n-J\) rows, each of which is a vector of the canonical basis, leaves — up to sign — exactly the non-zero \(J\times J\) minor just chosen, so \(\vect{\Psi}\) is a smooth diffeomorphism of a neighbourhood of \(\vect{p}\) onto a neighbourhood of \(\vect{\Psi}(\vect{p})=\vect{0}\) (Corollary 7.113), which we shrink to an open box \(B=B'\times B''\), \(B'\subseteq\R^{J}\), \(B''\subseteq\R^{n-J}\). Write \(\vect{y}=(\vect{y}',\vect{y}'')=\vect{\Psi}(\vect{x})\) and \(\tilde{f}=f\circ\vect{\Psi}^{-1}\), smooth on \(B\). By construction \(\vect{y}'=\left(\phi_1,\ldots,\phi_J\right)\), so \(\Sigma\) meets the chart in \(\set{\vect{y}'=\vect{0}}\) and \(\tilde{f}\) vanishes there.
Integrating along the segment. For \(\vect{y}\in B\) the segment from \((\vect{0},\vect{y}'')\) to \((\vect{y}',\vect{y}'')\) lies in the box \(B\), so the fundamental theorem of calculus (Theorem 7.43) and the chain rule Equation (7.91) give
where the integral computes \(\tilde{f}(\vect{y}',\vect{y}'')-\tilde{f}(\vect{0},\vect{y}'')\) and the subtracted term is zero because \(\tilde{f}\) vanishes on \(\set{\vect{y}'=\vect{0}}\). Each \(\tilde{c}_j\) is smooth: its integrand and every partial derivative of the integrand are continuous on \(B\times[0,1]\), so Theorem 7.109 may be applied to it as often as one pleases. Setting \(c^{j}=\tilde{c}_j\circ\vect{\Psi}\) and recalling \(y'^{\,j}=\phi_j(\vect{x})\) turns Equation (7.118) into Equation (7.116).
∎Let \(A\subseteq\R^{n}\) be open, let \(f\) and \(g_1,\ldots,g_J\) be of class \(C^{1}\) on \(A\) with \(J<n\), and let \(\vect{x}_\star\in A\) satisfy \(g_\alpha(\vect{x}_\star)=0\) for every \(\alpha\) and have linearly independent gradients \(\nabla g_\alpha(\vect{x}_\star)\). If the restriction of \(f\) to the constraint set \(\set{\vect{x}\in A\mid g_1(\vect{x})=\cdots=g_J(\vect{x})=0}\) has a local extremum at \(\vect{x}_\star\), then there are unique numbers \(\lambda^{1},\ldots,\lambda^{J}\) with
Rests on Theorem 7.112, Lemma 7.33 and Proposition 7.104.
Derives Proposition 7.117. Write \(\vect{G}=(g_1,\ldots,g_J)\). Its derivative at \(\vect{x}_\star\) has rank \(J\), so \(J\) of its columns are independent; relabelling the coordinates, split \(\vect{x}=(\vect{x}',\vect{y})\) with \(\vect{y}\in\R^{J}\) carrying those columns, so that \(\det\left[D_{\vect{y}}\vect{G}(\vect{x}_\star)\right]\neq0\). By Theorem 7.112 there are neighbourhoods \(W\ni\vect{x}'_\star\) and \(V\ni\vect{y}_\star\) and a \(C^{1}\) map \(\vect{h}:W\longrightarrow V\) whose graph is the constraint set inside \(W\times V\), with the derivative Equation (7.108).
The function \(\Xi(\vect{x}')=f\left(\vect{x}', \vect{h}(\vect{x}')\right)\) therefore has an ordinary, unconstrained local extremum at \(\vect{x}'_\star\); applying Lemma 7.33 to each one-variable function \(t\longmapsto \Xi(\vect{x}'_\star+t\vect{e}_i)\) gives \(\nabla\Xi(\vect{x}'_\star)=\vect{0}\), and the chain rule Equation (7.91) turns that into
everything evaluated at \(\vect{x}_\star\), the second equality being Equation (7.108). Now define the row vector \(\lambda=D_{\vect{y}}f\left[D_{\vect{y}}\vect{G}\right]^{-1}\), which exists and is unique because \(D_{\vect{y}}\vect{G}\) is invertible; unwinding, \(\lambda\) is the unique solution of \(\pp f/\pp y_j=\sum_\alpha\lambda^{\alpha}\pp g_\alpha/\pp y_j\), which is Equation (7.119) in the \(\vect{y}\) block. Substituting it into Equation (7.120),
which is Equation (7.119) in the \(\vect{x}'\) block. Uniqueness over all \(n\) components follows from the linear independence of the \(\nabla g_\alpha(\vect{x}_\star)\): two solutions would differ by a vanishing combination of them.
∎Proposition 7.117 is the finite-dimensional statement from which the functional multiplier rule of Calculus of Variations takes its name and its shape: the gradient of the objective lies in the span of the gradients of the constraints, so that the constrained problem is the unconstrained problem for \(f-\lambda^{\alpha}g_\alpha\). What the variational version must supply for itself is the infinite-dimensional replacement of the implicit function theorem used here; the algebra of the multipliers is the same. Rests on Proposition 7.117.
Let \(\Omega\subseteq\R^{n}\) be open, let \(I\subseteq\R\) be an open interval and let \(f:\Omega\times I\longrightarrow\R\) be of class \(C^{2}\). The member of the family labelled by \(a\in I\) is the level set \(S_a=\set{\vect{x}\in\Omega\mid f(\vect{x},a)=0}\), and the envelope of the family is
Let \(\vect{x}_0\in E\) with witness \(a_0\), and suppose that \(\nabla_{\vect{x}}f(\vect{x}_0,a_0)\neq\vect{0}\) and that \(\pp^{2}f/\pp a^{2}(\vect{x}_0,a_0)\neq0\). Then on a neighbourhood of \(\vect{x}_0\) the witness is a \(C^{1}\) function \(a(\vect{x})\), the set \(E\) is contained in the zero set of \(\Psi(\vect{x})=f\left(\vect{x},a(\vect{x})\right)\), and
Hence \(E\) and \(S_{a_0}\) have the same tangent plane at \(\vect{x}_0\): the envelope is tangent to the member through each of its points. Rests on Definition 7.119, Theorem 7.112 and Proposition 7.104.
Derives Proposition 7.120. Apply Theorem 7.112 to the scalar equation \(\pp f/\pp a(\vect{x},a)=0\) at \((\vect{x}_0,a_0)\), where the derivative with respect to \(a\) is \(\pp^{2}f/\pp a^{2}\neq0\): it returns a neighbourhood of \(\vect{x}_0\) and a \(C^{1}\) function \(a(\vect{x})\) with \(a(\vect{x}_0)=a_0\) and
identically there, and no other root of \(\pp f/\pp a\) nearby — so every point of \(E\) in that neighbourhood has \(a(\vect{x})\) as its witness and satisfies \(\Psi(\vect{x})=0\). By the chain rule Equation (7.91),
whose second term vanishes identically by Equation (7.123); at \(\vect{x}_0\) this is Equation (7.122). That same vector is the gradient at \(\vect{x}_0\) of \(\vect{x}\longmapsto f(\vect{x},a_0)\), the defining function of \(S_{a_0}\). Two level sets through one point whose defining functions have the same non-zero gradient there have the same tangent plane (Definition 7.96), which is the assertion.
∎Vector analysis
The nabla operator
Let \(\psi:\R^{3}\longrightarrow\R\) and \(\vect{A}:\R^{3}\longrightarrow\R^{3}\).
-
In Cartesian coordinates,
\begin{align} \nabla\psi &= \hat{\vect{x}}\,\pdv{\psi}{x} +\hat{\vect{y}}\,\pdv{\psi}{y} +\hat{\vect{z}}\,\pdv{\psi}{z}\ec \tag{7.124}\\ \nabla\cdot\vect{A} &= \pdv{A_x}{x}+\pdv{A_y}{y}+\pdv{A_z}{z}\ec \tag{7.125}\\ \nabla\times\vect{A} &= \hat{\vect{x}}\left(\pdv{A_z}{y}-\pdv{A_y}{z}\right) +\hat{\vect{y}}\left(\pdv{A_x}{z}-\pdv{A_z}{x}\right) +\hat{\vect{z}}\left(\pdv{A_y}{x}-\pdv{A_x}{y}\right)\ec \tag{7.126}\\ \nabla^{2}\psi=\nabla\cdot\nabla\psi &= \frac{\pp^{2}\psi}{\pp x^{2}} +\frac{\pp^{2}\psi}{\pp y^{2}} +\frac{\pp^{2}\psi}{\pp z^{2}}\ep \tag{7.127} \end{align} -
In cylindrical coordinates \((\rho,\varphi,z)\),
\begin{align} \nabla\psi &= \hat{\vect{\rho}}\,\pdv{\psi}{\rho} +\hat{\vect{\varphi}}\,\frac{1}{\rho}\pdv{\psi}{\varphi} +\hat{\vect{z}}\,\pdv{\psi}{z}\ec \tag{7.128}\\ \nabla\cdot\vect{A} &= \frac{1}{\rho}\pdv{(\rho A_\rho)}{\rho} +\frac{1}{\rho}\pdv{A_\varphi}{\varphi} +\pdv{A_z}{z}\ec \tag{7.129}\\ \nabla^{2}\psi &= \frac{1}{\rho}\,\pp_\rho\!\left(\rho\,\pp_\rho\psi\right) +\frac{1}{\rho^{2}}\,\pp^{2}_{\varphi}\psi +\pp^{2}_{z}\psi\ep \tag{7.130} \end{align} -
In spherical coordinates \((r,\theta,\varphi)\) (Figure 7.10),
\begin{align} \nabla\psi &= \hat{\vect{r}}\,\pdv{\psi}{r} +\hat{\vect{\theta}}\,\frac{1}{r}\pdv{\psi}{\theta} +\hat{\vect{\varphi}}\,\frac{1}{r\sin\theta}\pdv{\psi}{\varphi}\ec \tag{7.131}\\ \nabla\cdot\vect{A} &= \frac{1}{r^{2}}\pdv{(r^{2}A_r)}{r} +\frac{1}{r\sin\theta}\pdv{(\sin\theta\,A_\theta)}{\theta} +\frac{1}{r\sin\theta}\pdv{A_\varphi}{\varphi}\ec \tag{7.132}\\ \nabla^{2}\psi &= \frac{1}{r^{2}}\,\pp_r\!\left(r^{2}\,\pp_r\psi\right) +\frac{1}{r^{2}\sin\theta}\, \pp_\theta\!\left(\sin\theta\,\pp_\theta\psi\right) +\frac{1}{r^{2}\sin^{2}\theta}\,\pp^{2}_{\varphi}\psi\ep \tag{7.133} \end{align}The curl expressions in curvilinear coordinates follow from the general covariant machinery of Differentiable Manifolds, Tensors, and Curvature.
Spherical coordinates of a point in \(\R^{3}\).
Identities of the nabla calculus
Every identity below is an equality of Cartesian components, and each is proved by writing both sides in index notation. Indices \(i,j,k,l,m\) run over \(1,2,3\); a repeated index is summed; \(\pp_i=\pp/\pp x^{i}\); \(\delta_{ij}\) is the Kronecker delta, equal to \(1\) when \(i=j\) and \(0\) otherwise; and \(\epsilon_{ijk}\) is the Levi-Civita symbol, the totally antisymmetric array with \(\epsilon_{123}=+1\). In this notation Equation (7.126) and the cross product of two vectors of \(\R^{3}\) read
For all \(j,k,l,m\in\set{1,2,3}\),
the repeated index \(i\) being summed over \(1,2,3\). Rests on Equation (7.134).
Derives Lemma 7.121. Both sides change sign under \(j\leftrightarrow k\) and under \(l\leftrightarrow m\), and both vanish when \(j=k\) or \(l=m\); so only the cases with \(j\neq k\) and \(l\neq m\) need checking. On the left the sum over \(i\) has at most one surviving term, the one whose \(i\) differs from both \(j\) and \(k\), and it survives only if \(i\) also differs from \(l\) and \(m\) — that is, only if \(\set{l,m}\) is the same pair as \(\set{j,k}\). If \((l,m)=(j,k)\) that term is \(\left(\epsilon_{ijk}\right)^{2}=1\) and the right-hand side is \(1\cdot1-0=1\); if \((l,m)=(k,j)\) the term is \(\epsilon_{ijk}\epsilon_{ikj}=-1\) and the right-hand side is \(0-1\cdot1=-1\); and if \(\set{l,m}\neq\set{j,k}\) the left-hand side vanishes, while on the right \(\delta_{jl}\delta_{km}=1\) would force \((l,m)=(j,k)\) and \(\delta_{jm}\delta_{kl}=1\) would force \((l,m)=(k,j)\), so both products vanish too. This exhausts the cases.
∎Let \(\psi\) be a \(C^{1}\) scalar field and let \(\vect{A},\vect{B}\) be \(C^{1}\) vector fields on an open subset of \(\R^{3}\). Then
where \(\left(\vect{A}\cdot\nabla\right)\vect{B}\) denotes the vector with components \(A_j\,\pp_j B_i\). Setting \(\vect{B}=\vect{A}\) in Equation (7.140) gives the identity
which splits an advective derivative into a gradient and a term orthogonal to \(\vect{A}\). Rests on Lemma 7.121, Equation (7.134) and Proposition 7.30.
Derives Proposition 7.122. Throughout, the product rule Proposition 7.30 is applied to each Cartesian component and Equation (7.135) is used to contract the two symbols that appear whenever two cross products meet.
Equations (7.136) and (7.137). Directly, \(\pp_i(\psi A_i)=\psi\,\pp_i A_i+A_i\,\pp_i\psi\), which is the first; and \(\epsilon_{ijk}\pp_j(\psi A_k) =\psi\,\epsilon_{ijk}\pp_j A_k+\epsilon_{ijk}(\pp_j\psi)A_k\), whose second term is \(\left(\nabla\psi\times\vect{A}\right)_i\) by Equation (7.134).
Equation (7.138). \(\pp_i\left(\epsilon_{ijk}A_jB_k\right) =\epsilon_{ijk}\left(\pp_iA_j\right)B_k +\epsilon_{ijk}A_j\left(\pp_iB_k\right)\). In the first term relabel \(\epsilon_{ijk}=\epsilon_{kij}\), so that it is \(B_k\left(\nabla\times\vect{A}\right)_k\); in the second, \(\epsilon_{ijk}=-\epsilon_{jik}\), so that it is \(-A_j\left(\nabla\times\vect{B}\right)_j\).
Equation (7.139). Using Equation (7.134) twice and then Equation (7.135) with the summed index moved to the front of both symbols,
and expanding the two derivatives by the product rule gives \(A_i\,\pp_mB_m+B_m\,\pp_mA_i-B_i\,\pp_lA_l-A_l\,\pp_lB_i\), which is Equation (7.139) component by component.
Equation (7.140). By the same two steps,
and interchanging \(\vect{A}\) and \(\vect{B}\), \(\left[\vect{B}\times\left(\nabla\times\vect{A}\right)\right]_i =B_j\,\pp_iA_j-B_j\,\pp_jA_i\). Adding the two and using \(\pp_i\left(A_jB_j\right)=A_j\,\pp_iB_j+B_j\,\pp_iA_j\) rearranges to Equation (7.140). Equation (7.141) is the case \(\vect{B}=\vect{A}\), in which the two advective terms coincide and \(\pp_i(A_jA_j)=\pp_i\abs{\vect{A}}^{2}\), so that the whole identity may be divided by two.
∎Let \(\psi\) be a \(C^{2}\) scalar field and let \(\vect{A}\) be a \(C^{2}\) vector field on an open subset of \(\R^{3}\). Then
where \(\nabla^{2}\vect{A}\) is the vector whose Cartesian components are the Laplacians Equation (7.127) of the Cartesian components of \(\vect{A}\). The first of the three is Equation (7.167) of Proposition 7.136 below, recorded here so that the three second-order identities stand together. Rests on Lemma 7.121, Proposition 7.105 and Equation (7.127).
Derives Proposition 7.123. The first two are the contraction of an object antisymmetric in two indices with one symmetric in them. By Proposition 7.105 the second partial derivatives of a \(C^{2}\) field commute, so \(\pp_j\pp_k\psi\) is symmetric in \((j,k)\) while \(\epsilon_{ijk}\) is antisymmetric, and \(\left(\nabla\times\nabla\psi\right)_i=\epsilon_{ijk}\pp_j\pp_k\psi\) vanishes: interchanging the summation labels \(j\) and \(k\) turns the sum into minus itself. The same argument on \(\nabla\cdot\left(\nabla\times\vect{A}\right) =\epsilon_{ijk}\,\pp_i\pp_jA_k\) gives Equation (7.143). For the third, by Equation (7.134) and then Equation (7.135),
the last step again by Proposition 7.105, and this is Equation (7.144).
∎Equation (7.144) is the definition of \(\nabla^{2}\) on a vector field in any coordinate system other than the Cartesian one: the componentwise Laplacian of Equation (7.130) or Equation (7.133) applied to \(A_\rho\), \(A_\theta\) and the rest is not \(\nabla^{2}\vect{A}\), because those basis vectors themselves vary from point to point. The combination \(\nabla(\nabla\cdot\vect{A})-\nabla\times(\nabla\times\vect{A})\) is built from operations that are defined without reference to a basis and is therefore the right object to carry over; the covariant reading of the same statement is in Differentiable Manifolds, Tensors, and Curvature. Rests on Proposition 7.123 and Equation (7.133).
The integral theorems
The three classical integral theorems trade a derivative integrated over a region for the field itself integrated over the boundary of that region. They are the multivariable descendants of the fundamental theorem of calculus (Theorem 7.43), and each derivation below reduces to it. We first fix the integrals that appear in them.
Let \(R=[a_1,b_1]\times\cdots\times[a_N,b_N]\subset\R^{N}\) be a closed box and \(f:R\longrightarrow\R\) bounded. Partition each edge; the lower and upper sums of Equation (7.22) are then formed with the infimum and the supremum of \(f\) on each sub-box weighted by the volume of that sub-box, and \(f\) is integrable on \(R\), with integral \(\int_{R}f\), when the supremum of the lower sums and the infimum of the upper sums coincide. For a bounded \(D\subseteq R\), \(\int_{D}f\) means \(\int_{R}\tilde{f}\), where \(\tilde{f}\) agrees with \(f\) on \(D\) and vanishes off it. We write \(\iint_{D}\) and \(\iiint_{V}\) for \(N=2\) and \(N=3\), and \(\dd V=\dd x\,\dd y\,\dd z\). Rests on Definition 7.39 and Axiom 7.1.
Let \(\gamma\) be a piecewise-\(C^{1}\) path \(\vect{r}:[\alpha,\beta]\longrightarrow\R^{3}\) and let \(\vect{A}\) be continuous on its image. The line integral of \(\vect{A}\) along \(\gamma\) is
and in the plane, with \(\vect{r}(t)=(x(t),y(t))\),
Let \(S\) be a surface carried by a \(C^{1}\) parametrization \(\vect{r}:D\subseteq\R^{2}\longrightarrow\R^{3}\), injective on the interior of \(D\) and with \(\pp_u\vect{r}\times\pp_v\vect{r}\neq\vect{0}\) there. Its oriented surface element, and the flux of \(\vect{A}\) through \(S\), are
Reversing the orientation of \(\gamma\) or of \(S\) reverses the sign. Rests on Definitions 7.98 and 7.125.
A compact set \(D\subset\R^{2}\) is vertically simple if
for piecewise-\(C^{1}\) functions \(\varphi_1\le\varphi_2\) on \([a,b]\), and horizontally simple if it admits the same description with the two coordinates exchanged, between \(\psi_1\le\psi_2\) on \([c,d]\). It is simple if it is both. A compact \(V\subset\R^{3}\) is simple if, for each of the three coordinate directions, it is the region between the graphs of two piecewise-\(C^{1}\) functions over a simple plane region — for the \(z\) direction,
Three properties of the multiple integral are used repeatedly. A function continuous on a simple region is integrable there; the integral is additive over a decomposition of the region into finitely many pieces meeting only along their boundaries; and on a vertically simple region the integral of a continuous \(f\) reduces to the iterated integral
with the analogous statements on a horizontally simple region and in \(\R^{3}\). All three follow from the Darboux construction by the argument of Theorem 7.40 once one knows that the graph of a continuous \(\varphi\) carries no area: given \(\varepsilon>0\), uniform continuity (Theorem 7.25) splits \([a,b]\) into \(n\) subintervals on each of which \(\varphi\) varies by less than \(\varepsilon\), and the \(n\) rectangles so obtained cover the graph with total area at most \((b-a)\varepsilon\). Hence the boundary of a simple region contributes nothing to any upper–lower gap. These statements are inputs to what follows, not consequences of it. Rests on Definition 7.125, Theorem 7.40 and Theorem 7.25.
The one further property of the multiple integral that the physical parts use constantly is the several-variable substitution rule. In one variable it is Corollary 7.44; in \(N\) variables the derivative of the substitution is a matrix, and what replaces it is the modulus of the determinant.
Let \(U,V\subseteq\R^{N}\) be open and bounded and let \(\vect{\Phi}:U\longrightarrow V\) be a bijection of class \(C^{1}\) with \(\det D\vect{\Phi}(\vect{u})\neq0\) at every \(\vect{u}\in U\) — equivalently, by Corollary 7.113, a \(C^{1}\) bijection whose inverse is \(C^{1}\). Let \(f\) be continuous and bounded on \(V\). Then both integrals below exist in the sense of Definition 7.125 and are equal:
The same identity holds when \(\vect{\Phi}\) fails to be injective, or its determinant fails to be non-zero, on a set contained in finitely many graphs of continuous functions, since such a set contributes nothing to a Darboux sum (Remark 7.128). Rests on Definition 7.125, Corollary 7.113 and Remark 7.128.
Full derivation in Appendix A.
Derives Theorem 7.129.
In the plane, the polar map \(\vect{\Phi}(\rho,\varphi)=(\rho\cos\varphi,\rho\sin\varphi)\) has
so \(\dd x\,\dd y=\rho\,\dd\rho\,\dd\varphi\); in space, the spherical map of Figure 7.10, \((r,\theta,\varphi)\longmapsto(r\sin\theta\cos\varphi, r\sin\theta\sin\varphi,r\cos\theta)\), has \(\det D\vect{\Phi}=r^{2}\sin\theta\) on expanding the \(3\times3\) determinant along its last row, so \(\dd V=r^{2}\sin\theta\,\dd r\,\dd\theta\,\dd\varphi\). Each map is a diffeomorphism away from its coordinate degeneracies — \(\rho=0\) in the plane, \(r=0\) or \(\sin\theta=0\) in space — and those lie in finitely many graphs of continuous functions, so the last clause of Theorem 7.129 covers them. These are the volume elements used for the Gaussian integral of Probability and Statistics and for every radial integration in the physical parts. Rests on Theorem 7.129 and Equation (7.131).
Let \(D \subset \R^2\) be a region bounded by a piecewise-\(C^{1}\) simple closed curve \(\pp D\), traversed counterclockwise, and let \(P, Q\) be \(C^{1}\) on \(D \cup \pp D\). Then
Rests on Theorem 7.43, Definition 7.127 and Remark 7.128.
Derives Theorem 7.131. We derive the identity for a simple region (Definition 7.127) and then for any region that can be cut into finitely many of them; what that leaves uncovered is stated in Remark 7.134.
Step 1: the \(P\) term on a vertically simple region. Let \(D\) be as in Equation (7.149). Since \(\pp_y P\) is continuous, Equation (7.151) and the fundamental theorem of calculus (Theorem 7.43), applied in \(y\) at fixed \(x\), give
Traversed counterclockwise, \(\pp D\) consists of the lower graph \(x\longmapsto(x,\varphi_1(x))\) run from \(x=a\) to \(x=b\), the vertical segment at \(x=b\), the upper graph \(x\longmapsto(x,\varphi_2(x))\) run back from \(x=b\) to \(x=a\), and the vertical segment at \(x=a\). On the two vertical pieces \(x\) is constant, so \(x'(t)=0\) and they contribute nothing to Equation (7.146). Hence, using Equation (7.155) in the last step,
Step 2: the \(Q\) term on a horizontally simple region. With \(D=\set{(x,y) \mid c\le y\le d,\ \psi_1(y)\le x\le\psi_2(y)}\) the same two moves give
The counterclockwise boundary now runs up the right graph \(y\longmapsto(\psi_2(y),y)\) from \(y=c\) to \(y=d\), which is the sense that keeps the interior on the left, and down the left graph \(y\longmapsto(\psi_1(y),y)\) from \(y=d\) to \(y=c\); the two horizontal pieces have \(y'(t)=0\) and contribute nothing to \(\oint Q\,\dd y\). Therefore
Step 3: simple regions. On a region that is both vertically and horizontally simple, both steps apply, and adding Equation (7.156) to Equation (7.157) is exactly Equation (7.154).
Step 4: decomposition. Let \(D=\bigcup_{k=1}^{N}D_k\) with every \(D_k\) simple and any two of them meeting at most along parts of their boundaries. Summing Equation (7.154) over \(k\), the area integrals add to \(\iint_{D}\left(\pp_x Q-\pp_y P\right)\) by additivity (Remark 7.128). On the boundary side, an arc interior to \(D\) belongs to exactly two of the \(\pp D_k\), whose regions lie on opposite sides of it, so it is traversed once in each direction; the two line integrals then cancel, since reversing the parametrization reverses the sign of Equation (7.146). What survives is the integral over the arcs making up \(\pp D\), traversed counterclockwise.
∎For an oriented piecewise-smooth surface \(S\) with boundary curve \(\pp S\) (oriented compatibly) and \(\vect{A} \in C^{1}\),
Rests on Theorem 7.131, Proposition 7.104 and Proposition 7.105.
Derives Theorem 7.132. It suffices to treat a surface that is a graph over a plane region to which Theorem 7.131 applies: a piecewise-smooth oriented surface can be cut into finitely many such pieces — after a permutation of the coordinate axes for each — and the line integrals along the interior cuts cancel in pairs exactly as in Step 4 of the derivation of Theorem 7.131.
So let \(S=\set{(x,y,g(x,y))\in\R^{3} \mid (x,y)\in D}\) with \(g\) of class \(C^{2}\) on a neighbourhood of \(D\), oriented by the upward normal. The parametrization \(\vect{r}(x,y)=(x,y,g(x,y))\) has
whose third component is positive, so Equation (7.147) with this parametrization is the chosen orientation; and \(\pp S\) is the lift of \(\pp D\), traversed so that \(\pp D\) runs counterclockwise.
The line integral. Parametrize \(\pp D\) by \(t\longmapsto(x(t),y(t))\). Its lift has \(z(t)=g(x(t),y(t))\), so the chain rule (Proposition 7.104) gives \(z'=\pp_x g\,x'+\pp_y g\,y'\). Writing \(\tilde{A}_i(x,y)=A_i(x,y,g(x,y))\) and collecting the coefficients of \(x'\) and \(y'\) in Equation (7.145),
Both \(P\) and \(Q\) are \(C^{1}\) on \(D\), because \(\vect{A}\) is \(C^{1}\) and \(g\) is \(C^{2}\).
Green's theorem. Apply Theorem 7.131 to Equation (7.160). The chain rule (Equation (7.91), applied to the composition of \((x,y)\longmapsto(x,y,g(x,y))\) with \(A_i\)) gives \(\pp_x\tilde{A}_i=\pp_x A_i+\pp_z A_i\,\pp_x g\) and \(\pp_y\tilde{A}_i=\pp_y A_i+\pp_z A_i\,\pp_y g\), every partial derivative of \(A_i\) being evaluated on \(S\), so that
On subtraction the two second-derivative terms cancel by Clairaut–Schwarz (Proposition 7.105), which is the one place where \(g\) is required to be \(C^{2}\), and so do the two terms carrying \(\pp_z A_z\,\pp_x g\,\pp_y g\). What is left is
the second line being just Equation (7.126) read component by component. Integrating Equation (7.161) over \(D\) and comparing with Equation (7.148) and Equation (7.159),
which is Equation (7.158).
∎For a bounded region \(V \subset \R^3\) with piecewise-smooth boundary \(\pp V\), outward oriented, and \(\vect{A} \in C^{1}\),
Rests on Theorem 7.43, Definition 7.127 and Remark 7.128.
Derives Theorem 7.133. Again we derive the identity for a simple region (Definition 7.127) and extend it by decomposition.
The \(z\) component. Let \(V\) be as in Equation (7.150). Because \(\pp_z A_z\) is continuous, the three-dimensional form of Equation (7.151) and the fundamental theorem of calculus (Theorem 7.43), applied in \(z\) at fixed \((x,y)\), give
The boundary \(\pp V\) splits into the upper cap \(z=\chi_2\), the lower cap \(z=\chi_1\), and a lateral part on which the outward normal is horizontal — possibly empty, as for a ball, whose two caps meet along the equator. On the upper cap the parametrization \(\vect{r}(x,y)=(x,y,\chi_2(x,y))\) has \(\pp_x\vect{r}\times\pp_y\vect{r} =(-\pp_x\chi_2,\,-\pp_y\chi_2,\,1)\), whose third component is positive; this is therefore the outward orientation, and Equation (7.148) gives \(\iint A_z\,\hat{\vect{z}}\cdot\dd\vect{S} =\iint_{D_z}A_z(x,y,\chi_2)\,\dd x\,\dd y\). On the lower cap the outward normal points downwards, so \(\dd\vect{S}=(\pp_x\chi_1,\,\pp_y\chi_1,\,-1)\,\dd x\,\dd y\) and the same computation returns \(-\iint_{D_z}A_z(x,y,\chi_1)\,\dd x\,\dd y\). On the lateral part \(\hat{\vect{z}}\cdot\dd\vect{S}=0\). Adding the three contributions and comparing with Equation (7.163),
The other two components. Because \(V\) is simple in all three coordinate directions, the identical argument with the axes permuted gives the analogues of Equation (7.164) for \(A_x\hat{\vect{x}}\) and \(A_y\hat{\vect{y}}\). Adding the three identities, and using \(\vect{A}=A_x\hat{\vect{x}}+A_y\hat{\vect{y}}+A_z\hat{\vect{z}}\) together with Equation (7.125), yields Equation (7.162).
Decomposition. If \(V=\bigcup_{k}V_k\) with every \(V_k\) simple and any two meeting at most along parts of their boundaries, summing the identity over \(k\) adds the volume integrals. On the surface side an interior face belongs to exactly two of the \(\pp V_k\), which assign it opposite outward normals, so those two fluxes cancel; the flux through \(\pp V\) is what remains.
∎Three limitations should be stated exactly. First, the derivations cover every region and every surface that decomposes into finitely many simple pieces (Definition 7.127) — which is every region and surface this treatise integrates over — but not an arbitrary region bounded by a piecewise-\(C^{1}\) curve; the passage to that generality is an exhaustion argument, not carried out here. Second, the derivation of Theorem 7.132 asks the surface to be \(C^{2}\), one degree smoother than the statement, because it applies Clairaut–Schwarz to the height function; the \(C^{1}\) case follows by approximating the surface, again not done here. Third, the flux Equation (7.148) was defined through a parametrization, and its independence of that choice rests on the change-of-variables formula Theorem 7.129: two parametrizations of one surface differ by a \(C^{1}\) diffeomorphism of their parameter domains, and Equation (7.152) converts one integral into the other, the Jacobian factor cancelling the corresponding factor in \(\pp_u\vect{r}\times\pp_v\vect{r}\).
The three theorems are instances of a single statement, the general Stokes theorem \(\int_{M}\dd\omega=\int_{\pp M}\omega\) for a differential form \(\omega\) on an oriented manifold with boundary: Theorem 7.131 is the case of a \(1\)-form on a plane region, Theorem 7.132 that of a \(1\)-form on a surface in \(\R^{3}\), and Theorem 7.133 that of a \(2\)-form on a solid. The language for that formulation is built in Differentiable Manifolds, Tensors, and Curvature, where the antisymmetric-tensor form Equation (13.231) is stated — but its derivation is still owed there, which is why the classical theorems are proved directly above rather than deduced from it.
Conservative fields
For a function \(\vect{F}:A\subseteq\R^{3}\longrightarrow\R^{3}\), with \(A\) an open connected set, we say that \(\vect{F}\) is conservative on \(A\) if and only if
Rests on Equation (7.124).
Let \(A\) be open and connected.
-
If \(\vect{F} = \nabla f\) on \(A\) and \(L\subseteq A\) is a closed piecewise-\(C^1\) loop, then
\begin{equation}\tag{7.166} \oint_{L}\vect{F}\cdot\dd\vect{l}=0\ep \end{equation} -
If \(\vect{F}\in C^{1}(A)\) is conservative, then
\begin{equation}\tag{7.167} \nabla\times\vect{F}=\vect{0}\ep \end{equation} -
If \(\vect{F}\in C^{1}(A)\), \(A\) is moreover simply connected (Topological and Metric Spaces), and \(\nabla\times\vect{F}=\vect{0}\), then \(\vect{F}\) is conservative.
Rests on Definition 7.135, Proposition 7.104 and Theorem 7.132.
Derives Proposition 7.136. (1) Parametrize the loop by \(\vect{r}(t)\), \(t \in [0,1]\), with \(\vect{r}(0) = \vect{r}(1)\). By the chain rule (Proposition 7.104), \(\dv{}{t} f(\vect{r}(t)) = \nabla f(\vect{r}(t))\cdot\vect{r}'(t)\), so
by the fundamental theorem of calculus (Theorem 7.43). (2) Componentwise, e.g.\ \((\nabla\times\nabla f)_z = \pp_x\pp_y f - \pp_y\pp_x f = 0\) by Clairaut–Schwarz (Proposition 7.105); the hypothesis \(\vect{F} \in C^1\) makes \(f\) twice continuously differentiable. (3) Fix \(\vect{a} \in A\) and define \(f(\vect{p}) = \int_{\gamma}\vect{F}\cdot\dd\vect{l}\) along any path \(\gamma \subset A\) from \(\vect{a}\) to \(\vect{p}\). Well-definedness is the point: two paths bound (by simple connectedness) a surface swept by a homotopy inside \(A\), and Stokes' theorem (Theorem 7.132) with \(\nabla\times\vect{F} = \vect{0}\) makes the two line integrals equal. Differentiating along a coordinate step then gives \(\pp_i f = F_i\), i.e. \(\nabla f = \vect{F}\).
∎The Helmholtz decomposition
Proposition 7.136 says when a field is a gradient; the companion statement says that an arbitrary field is a gradient plus a curl. It is the capstone of this section, and it is what licenses the routine physical move of splitting a vector field into an irrotational and a solenoidal part and treating the two separately.
Let \(\vect{u}:\R^{3}\longrightarrow\R^{3}\) be smooth with compact support. Then there are a smooth scalar field \(\phi\) and a smooth vector field \(\vect{\Psi}\) on \(\R^{3}\) with
namely
The first summand is curl-free and the second divergence-free (Proposition 7.123), and the two are unique: if \(\nabla\phi_1+\nabla\times\vect{\Psi}_1 =\nabla\phi_2+\nabla\times\vect{\Psi}_2\) with all four fields tending to zero at infinity, then \(\nabla\phi_1=\nabla\phi_2\) and \(\nabla\times\vect{\Psi}_1=\nabla\times\vect{\Psi}_2\). Rests on Proposition 7.123, Proposition 10.67 and Theorem 7.109.
Full derivation in Appendix A.
Derives Theorem 7.137.
The mechanism is worth stating even though the estimates are not. Each Cartesian component of \(\vect{w}\) is the Newtonian potential of the corresponding component of \(\vect{u}\), so \(\nabla^{2}\vect{w}=\vect{u}\) by Proposition 10.67; and Equation (7.144), read backwards, turns that Laplacian into \(\nabla(\nabla\cdot\vect{w})-\nabla\times(\nabla\times\vect{w})\), which is Equation (7.168) with the potentials Equation (7.169). That \(\nabla\cdot\vect{\Psi}=0\) is Equation (7.143). Uniqueness is the observation that the difference of two decompositions is a field that is at once a gradient and a curl, hence by Equations (7.142) and (7.143) both curl-free and divergence-free, hence harmonic in each component by Equation (7.144); a harmonic function on \(\R^{3}\) that tends to zero at infinity vanishes, by the maximum principle Theorem 10.75 applied on balls of growing radius. What the appendix supplies is the analytic work the display above skips: that the singular integral Equation (7.169) may be differentiated under the integral sign as often as one likes — Theorem 7.109 after the singularity has been excised, with the excised part estimated uniformly — and that the result decays.
Sets of measure zero and Hausdorff dimension
The Darboux construction already asks which sets are small enough to be ignored: the graph of a continuous function carries no area (Remark 7.128), which is why the boundary of a simple region contributes nothing to an integral. This section makes “small” precise in the two senses the physical parts use — a set of measure zero, and the dimension of a set that is small in no whole number of dimensions. Neither needs the Lebesgue integral, and this treatise does not construct it; what is defined here is the covering notion alone, and every statement below is proved from it.
A set \(E\subseteq\R^{N}\) is null, or of measure zero, if for every \(\varepsilon>0\) there is a countable family of boxes \(R_1,R_2,\ldots\) (Definition 7.125) with
where \(\mathrm{vol}\,R\) is the product of the edge lengths of \(R\). Rests on Definitions 3.65 and 7.125.
If \(E_1,E_2,\ldots\) are null subsets of \(\R^{N}\) then so is \(\bigcup_{j\ge1}E_j\). In particular every countable subset of \(\R^{N}\) is null, and the rational points \(\Q^{N}\) are a null set. Rests on Definition 7.138, Proposition 7.46 and Proposition 3.67.
Derives Lemma 7.139. Let \(\varepsilon>0\). For each \(j\) choose, by Definition 7.138, a countable family of boxes covering \(E_j\) of total volume less than \(\varepsilon2^{-j}\). The union of these families is a countable family — a countable union of countable families is countable, by Proposition 3.67 — it covers \(\bigcup_jE_j\), and its total volume is at most \(\sum_{j\ge1}\varepsilon2^{-j}=\varepsilon\) by the geometric series (Proposition 7.46). A single point is null, being contained in a cube of arbitrarily small volume, so a countable set is a countable union of null sets and the first part applies; and \(\Q^{N}\) is countable by Corollary 3.68 and Proposition 3.67.
∎The diameter of a non-empty \(U\subseteq\R^{N}\) is \(\mathrm{diam}\,U=\sup\set{\abs{\vect{p}-\vect{q}}\mid \vect{p},\vect{q}\in U}\). For \(E\subseteq\R^{N}\), \(s\ge0\) and \(\delta>0\) let
the infimum taken over all countable families \(\set{U_k}\) that cover \(E\) and satisfy \(\mathrm{diam}\,U_k\le\delta\), with the convention that an empty set of competitors gives \(+\infty\). Fewer families compete as \(\delta\) decreases, so \(\mathcal{H}^{s}_{\delta}(E)\) does not decrease, and the \(s\)-dimensional Hausdorff measure
exists. The normalising constants that make \(\mathcal{H}^{N}\) agree with the ordinary volume on \(\R^{N}\) are omitted; nothing below needs them. Rests on Definition 7.138, Definition 6.24 and Axiom 7.1.
For every \(E\subseteq\R^{N}\) there is exactly one \(d=\dim_{\mathrm{H}}E\in[0,N]\), called the Hausdorff dimension of \(E\), with
Moreover \(\mathcal{H}^{N}(E)=0\) implies that \(E\) is null in the sense of Definition 7.138; in particular every set of Hausdorff dimension smaller than \(N\) is null. Rests on Definition 7.140, Definition 7.138 and Lemma 7.139.
Derives Proposition 7.141. One threshold. Let \(0\le s<t\) and suppose \(\mathcal{H}^{s}(E)<\infty\). For any family covering \(E\) with diameters at most \(\delta\),
so \(\mathcal{H}^{t}_{\delta}(E)\le\delta^{\,t-s} \mathcal{H}^{s}_{\delta}(E)\le\delta^{\,t-s}\mathcal{H}^{s}(E)\), which tends to \(0\) as \(\delta\longrightarrow0^{+}\): hence \(\mathcal{H}^{t}(E)=0\) for every \(t>s\). Consequently the set \(Z=\set{s\ge0\mid\mathcal{H}^{s}(E)=0}\) contains, with any of its points, every larger one, and contains every \(s\) at which \(\mathcal{H}^{s}(E)\) is merely finite together with everything above it. Put \(d=\inf Z\), which exists by Axiom 7.1 once \(Z\) is known to be non-empty — the next paragraph shows \((N,\infty)\subseteq Z\). If \(s>d\) there is \(t\in Z\) with \(t<s\), so \(\mathcal{H}^{s}(E)=0\). If \(s<d\) then \(\mathcal{H}^{s}(E)\) cannot be finite: were it finite, every \(t>s\) would lie in \(Z\) and \(\inf Z\) would be at most \(s<d\). So \(\mathcal{H}^{s}(E)=+\infty\), which is Equation (7.173); and those two clauses determine \(d\) as \(\inf Z\), so it is unique.
The bound \(d\le N\). It is enough to show \(\mathcal{H}^{s}(E)=0\) for every \(s>N\). First, \(\mathcal{H}^{s}_{\delta}\) is countably subadditive — covers of the pieces concatenate into a cover of the union — so \(\mathcal{H}^{s}_{\delta}\left(\bigcup_jE_j\right) \le\sum_j\mathcal{H}^{s}_{\delta}(E_j) \le\sum_j\mathcal{H}^{s}(E_j)\), and letting \(\delta\longrightarrow0^{+}\) shows \(\mathcal{H}^{s}\) is countably subadditive too. Since \(\R^{N}\) is the union of countably many unit lattice cubes, it is enough to treat \(E\) inside one such cube \(Q\). Split \(Q\) into \(n^{N}\) closed subcubes of edge \(1/n\), hence of diameter \(\sqrt{N}/n\): they cover \(E\), and
whenever \(s>N\), while their diameters tend to \(0\). Hence \(\mathcal{H}^{s}_{\delta}(E)=0\) for every \(\delta>0\), so \(\mathcal{H}^{s}(E)=0\).
Null sets. Suppose \(\mathcal{H}^{N}(E)=0\) and let \(\varepsilon>0\). Choose a family \(\set{U_k}\) covering \(E\) with \(\sum_k\left(\mathrm{diam}\,U_k\right)^{N}<\varepsilon\). A set of diameter \(t\) has each of its \(N\) coordinate projections contained in an interval of length \(t\), hence lies in a closed cube of edge \(t\) and volume \(t^{N}\). Replacing each \(U_k\) by such a cube covers \(E\) by countably many boxes of total volume less than \(\varepsilon\), which is Equation (7.170). If \(\dim_{\mathrm{H}}E<N\) then \(\mathcal{H}^{N}(E)=0\) by Equation (7.173), so \(E\) is null.
∎For a bounded non-empty \(E\subseteq\R^{N}\) let \(N_\delta(E)\) be the least number of sets of diameter at most \(\delta\) needed to cover \(E\), a finite number because \(E\) is bounded. The upper and lower box-counting dimensions of \(E\) are
and where the two agree their common value is the box-counting dimension \(\dim_{\mathrm{B}}E\). It is this quantity, not the Hausdorff dimension, that a numerical box-count measures. Rests on Definitions 6.9 and 7.140.
For every bounded non-empty \(E\subseteq\R^{N}\),
and the first inequality can be strict: the rationals of \([0,1]\) have Hausdorff dimension \(0\) and box-counting dimension \(1\). Rests on Definition 7.142, Proposition 7.141 and Lemma 7.139.
Derives Proposition 7.143. The second inequality is the definition of a lower and an upper limit. For the first, let \(s>\underline{\dim}_{\mathrm{B}}E\) and pick \(s'\) with \(\underline{\dim}_{\mathrm{B}}E<s'<s\). By Equation (7.175) there is a sequence \(\delta_1>\delta_2>\cdots\longrightarrow0\) along which \(\ln N_{\delta_j}(E)/\ln(1/\delta_j)<s'\), that is \(N_{\delta_j}(E)<\delta_j^{-s'}\). Covering \(E\) by that many sets of diameter at most \(\delta_j\),
and since \(\mathcal{H}^{s}(E)\) is the limit of \(\mathcal{H}^{s}_{\delta}(E)\) along any sequence \(\delta\longrightarrow0^{+}\) (Equation (7.172)), it follows that \(\mathcal{H}^{s}(E)=0\) and hence \(\dim_{\mathrm{H}}E\le s\) by Equation (7.173). Letting \(s\) decrease to \(\underline{\dim}_{\mathrm{B}}E\) gives Equation (7.176).
For the example, let \(E=\Q\cap[0,1]\). It is countable, so for \(s>0\) and \(\varepsilon\in(0,\delta)\) covering its \(k\)-th point by an interval of length \(\varepsilon2^{-k}\) gives \(\mathcal{H}^{s}_{\delta}(E)\le\varepsilon^{s} \sum_{k\ge1}2^{-ks}=\varepsilon^{s}/(2^{s}-1)\), which tends to \(0\) with \(\varepsilon\); hence \(\mathcal{H}^{s}(E)=0\) for every \(s>0\) and \(\dim_{\mathrm{H}}E=0\) (consistently with Lemma 7.139, which already makes \(E\) null). But any cover of \(E\) by sets of diameter at most \(\delta\) may be replaced by the cover by their closures, of the same diameters, which then covers the closure \([0,1]\) of \(E\); so \(N_\delta(E)\ge1/\delta\), and Equation (7.175) gives \(\underline{\dim}_{\mathrm{B}}E\ge1\), while \(E\subseteq[0,1]\) forces \(\overline{\dim}_{\mathrm{B}}E\le1\).
∎Exactly three notions are constructed above — the null set, the Hausdorff measures \(\mathcal{H}^{s}\), and the two counting dimensions — and nothing else is assumed. The Lebesgue integral, the \(\sigma\)-algebra of measurable sets and the countable additivity of a measure defined on it are not built in this treatise, and no statement in it rests on them: where an argument needs “almost every point” it needs Definition 7.138 and Lemma 7.139, and where it needs a fractal dimension it needs Definition 7.140 or Definition 7.142. The integral used throughout remains the Darboux–Riemann integral of Definition 7.39 and Definition 7.125. Rests on Definitions 7.138, 7.140 and 7.142.
Functional calculus
A functional assigns a number to a whole function, the archetype being the action integral \(S[q] = \int_{t_1}^{t_2} \Lag(q(t), \dot q(t), t)\,\dd t\) of Lagrangian Mechanics. The functional derivative \(\delta S/\delta q(t)\) is defined by the first-order response
for arbitrary smooth variations \(\eta\) vanishing at the endpoints. Its calculus — the Euler–Lagrange equation, constrained variations, second variations — is developed where it is first needed, in Lagrangian Mechanics, with the general field-theoretic case in Generalized Classical Field Theory.
The Dirac delta
No function \(\delta : \R \to \R\) satisfies \(\int f(x)\,\delta(x)\,\dd x = f(0)\) for all continuous \(f\); the Dirac delta is instead a distribution: the linear functional \(\delta : f \longmapsto f(0)\) on smooth test functions of compact support. The integral notation
is shorthand for its action, the sifting property, which is the definition rather than a theorem.
Let \(\delta_\sigma(x) = \dfrac{1}{\sigma\sqrt{2\pi}}\,\ee^{-x^{2}/2\sigma^{2}}\). Then for every bounded continuous \(f\),
and, as distributions, \(\delta(ax) = \delta(x)/\abs{a}\) for \(a \neq 0\), and \(x\,\delta(x) = 0\). Rests on Equation (7.178), Corollary 7.44 and Definition 7.20.
Derives Proposition 7.145. Each \(\delta_\sigma\) is positive with unit integral (the Gaussian integral; computed in Probability and Statistics), so
Split the domain at \(\abs{x - x_0} = \eta\): on the inner part continuity makes \(\abs{f - f(x_0)} < \varepsilon\) and the weight integrates to at most \(1\); on the outer part \(\abs{f - f(x_0)} \le 2\sup\abs{f}\) while the Gaussian tail mass tends to \(0\) as \(\sigma \to 0\) for fixed \(\eta\). Both contributions are eventually below \(\varepsilon\). The scaling rule follows by substituting \(u = ax\) in \(\int f(x)\,\delta(ax)\,\dd x\) (Corollary 7.44), which gives \(f(0)/\abs{a}\) (the sign of \(a\) flips the orientation, whence the absolute value); and \(\int f(x)\,x\,\delta(x)\,\dd x = 0\cdot f(0) = 0\) for every test function, which is the meaning of \(x\,\delta(x) = 0\).
∎The three-dimensional delta \(\delta^{3}(\vect{r}) = \delta(x)\delta(y)\delta(z)\) represents point sources; its central identity for field theory,
is derived where it is used, in electrostatics (Electrostatics).