7.2Compactness in Metric Spaces
Chapter (PDF)We have already shown a plethora of equivalences of compactness in metric spaces. Namely, being compact, sequentially compact, limit point compact, and having the finite intersection property are all equivalent in metric spaces.
Immediately, we note that compact metric spaces are complete. Indeed, compactness is equivalent with sequential compactness and so Cauchy sequences have convergent subsequences, so the space is complete. Complete metric spaces are not automatically compact, however (consider ). We seek to find a condition on metric spaces that, together with completeness, is equivalent to compactness.
A metric space is said to be totally bounded if, for any , there exist finitely many -balls that cover .
Note that any totally bounded space is bounded. Indeed, choose such that covers the entire space. From this, we have that is an upper bound on the diameter of the space, implying it is bounded. Bounded spaces are not totally bounded, though. is bounded under the standard bounded metric , but is not totally bounded (a countably infinite number of balls of radius would be needed to cover ).
Take the metric and the space . It is complete but not totally bounded. Now consider . It is totally bounded but not complete. Finally, note that is both complete and totally bounded.
The example from before illustrates an example of a crucial theorem. A metric space is compact if and only if it is complete and totally bounded. Note this resembles the theorem in that a set is compact iff closed (i.e., complete) and bounded (i.e., totally bounded).
A metric space is compact if and only if it is complete and totally bounded.
: Suppose is compact. Then is sequentially compact, meaning any Cauchy sequence admits a convergent subsequence, making complete. Moreover, for any , the open cover has a finite subcover , making totally bounded.
: Suppose is complete and totally bounded. Let be any sequence. Since is totally bounded, there exists a finite set of balls such that for every . By pigeonhole, there exists some such that infinitely many points of the sequence lie in . Choose a single point in the ball from this sequence and label it . Now note we may partition the ball by finitely many balls of radius , find infinitely many points of inside one of these balls, and label it (such that ). Repeat this for ball of radius and choosing (such that ), and by induction, choose through the ball of radius (such that is greater than all previous choices). Since , we have that there exists some such that for every . Thus any sequence has a Cauchy subsequence, and since is complete, it is convergent. Thus is sequentially compact and thus compact.
The goal for the rest of this section is to characterize the compact subsets of , the metric space of continuous maps from a topological space to together with the sup metric. We use the result from before to identify compact subsets, culminating into what is known as the Arzela-Ascoli theorem. This theorem characterizes all compact subsets of with the sup metric as precisely the subsets that are closed, uniformly bounded, and equicontinuous.
Suppose is a topological space and is a metric space. Let be a family of functions . For any , we say the family is equicontinuous at if, for any , there exists a single neighborhood of such that, for every and ,
If is equicontinuous at all points in , we say the family is simply equicontinuous.
Recall that for to be continuous at , we need that for any there exists an open neighborhood of such that
for every . Compare this to equicontinuity: for to be equicontinuous at , we need this relation to hold for every for only one . Note that if is metric, then the open neighborhood of would just be a -neighborhood.
Suppose is a topological space and a metric space. If is totally bounded under the uniform metric , then it is equicontinuous under the metric .
Suppose is totally bounded. Fix and . We seek to show there exists a neighborhood of such that for every and . Since , we use and interchangeably, for they are equivalent.
Let . Since is totally bounded, note there exists finitely many open balls from that covers . Note that each is continuous, and so we can choose an open neighborhood of , we have that
for every and .
Fix any . From the finite covering of , choose some such that . Finally, note
We get this relationship from the fact that , as well as how we chose . If , then just apply the same procedure to some . Thus is equicontinuous.
Suppose is a topological space and is a metric space. If is equicontinuous under , as well as and being compact, we have that is totally bounded under the uniform and sup metrics.
In sum, if is totally bounded it is equicontinuous, and if it is equicontinuous (together with compact) it is totally bounded.
Suppose is a topological space and is a metric space. A family of functions is said to be pointwise bounded under if, for each , the set is bounded under .
Suppose is a topological space and is a metric space. A family of functions is said to be uniformly bounded under if there exists a point and a real number such that
for every and . If is a normed space such as , this is equivalent to saying there is some such that for all and . Note that is uniformly bounded under if and only if is bounded as a subset of under the sup metric .
Let be a compact space and Euclidean space together with either the Euclidean or square metric. Give the corresponding sup metric. A subspace has compact closure if and only if it is equicontinuous and pointwise bounded under 's metric.
Let be a compact space and Euclidean space together with either the Euclidean or square metric. Give the corresponding sup metric. A subspace is compact if and only if it is closed, bounded under the sup metric, and equicontinuous under 's metric.
The entirety of this section is dedicated to answering one question: what does a compact set look like in an infinite-dimensional function space? In finite dimensions (), Heine-Borel tells us that a set is compact if and only if it is closed and bounded. In infinite dimensions, this fails; a sequence of functions bounded between and can oscillate infinitely fast, never converging to anything.
To fix this, we look to metric spaces in general: a space is compact if and only if it is complete and totally bounded. We simply translate these two topological conditions into analytic conditions for functions. Because the uniform metric space is already complete, demanding that a subspace be complete is exactly equivalent to demanding that be closed. Thus our task boils down to finding an analytic condition on functions that is equivalent to total boundedness. Indeed, we proved lemmas that if a family of functions can be covered by finitely many -balls (total boundedness), it is forced to be equicontinuous, which prevents the functions from oscillating wildly. This is an equivalence (i.e., the converse is true) if the domain and codomain of these functions are compact.
We are not done yet, however. To characterize the compact subsets of , we cannot directly use this equivalence between total boundedness and equicontinuity. Indeed, the codomain is not compact. This is why pointwise boundedness is introduced.
Suppose is pointwise bounded and equicontinuous and is compact. We show these conditions force the family to be uniformly bounded. For each , equicontinuity gives an open neighborhood of such that for every and . Since is pointwise bounded, we have that for each . Then for any and any , note that
Thus each is bounded in each . Since is an open cover for and is compact, there is a finite subcover . Simply choose the maximum of the upper bounds from this finite collection, and this is what every function is bounded above by on all of . Thus is uniformly bounded.
This guarantees that the images of all functions in lie inside a finite-radius closed ball in . By the standard Heine-Borel theorem for Euclidean space, this closed ball is compact. Thus, enforcing to be pointwise bounded gives us an easy route to equate total boundedness and equicontinuity, since the images of these functions all lie in a compact codomain. Assembling the pieces: is equicontinuous and pointwise bounded if and only if it is totally bounded, which together with the completeness of characterizes the subspaces with compact closure. This is the first version of the theorem.
The two versions of the Arzela-Ascoli theorem state the exact same mathematical fact. Note that in any metric space, a set is compact if and only if it is closed and its closure is compact.
The first version tells us exactly when the closure is compact (when is equicontinuous and pointwise bounded). The second version simply adds the “closed” requirement to the checklist so that , meaning itself is compact.
Furthermore, the first version requires the weaker condition of pointwise boundedness, while the second version requires boundedness under the sup metric, i.e.uniform boundedness. This is a free upgrade: if a family of functions is equicontinuous and pointwise bounded on a compact domain, it is automatically uniformly bounded, as shown above. The first version is often preferred in practice because checking pointwise bounds is algebraically much easier than proving uniform bounds.