1 Definition and basic viewpoints
Weak convergence describes how a sequence (or net) approaches a limit by checking its action on a chosen family of “test” objects rather than demanding direct pointwise or norm convergence. Instead of monitoring the size of differences everywhere, one monitors how the sequence behaves when paired with probes—such as continuous linear functionals or bounded continuous test functions.
1.1 Weak convergence in normed linear spaces
Let \(X\) be a normed linear space and \((x_n)\) a sequence in \(X\). A point \(x\in X\) is called the weak limit of \((x_n)\) if for every continuous linear functional \(f\in X^\*\), \[ f(x_n)\to f(x). \] In this case one writes \(x_n \rightharpoonup x\) (or \(x_n \to_w x\)).
1.1.1 Continuous linear functionals as probes
Continuous linear functionals act as “measurement devices” that reduce the vector-valued problem to scalar limits. Because each functional is continuous, small changes in the vector can yield controlled changes in the output, but weak convergence requires convergence only in this induced scalar sense. The choice of all continuous linear functionals is what makes the notion intrinsic to the topology of \(X\).
1.1.2 Weak topology and convergence criteria
The weak topology on \(X\) is the coarsest topology making all functionals \(f\in X^\*\) continuous. With this topology, \(x_n\rightharpoonup x\) is exactly the statement that \(x_n\) converges to \(x\) in the weak topology. Standard convergence criteria then take the form: a sequence converges weakly precisely when every probe functional evaluates to the appropriate limit.
1.2 Weak convergence of probability measures
Weak convergence is also central for probability measures. Given probability measures \(\mu_n\) and \(\mu\) on a metric space (or more generally a topological space with suitable structure), \(\mu_n\) is said to converge weakly to \(\mu\) if the integrals against bounded continuous test functions converge: \[ \int \varphi\, d\mu_n \to \int \varphi\, d\mu \quad \text{for all bounded continuous } \varphi. \] This definition captures convergence in distribution in common probabilistic settings.
1.2.1 Convergence against bounded continuous test functions
Bounded continuous functions are robust test functions: they respect the topology of the underlying space and are sufficient to determine the limit measure in many settings. The boundedness condition avoids uncontrolled behavior at infinity and ensures the integrals are well-defined and stable under limits.
1.2.2 Relation to characteristic functions and moment conditions
In \(\mathbb{R}^d\), characteristic functions provide an often-used alternative probe. If \(\mu_n\) and \(\mu\) are probability measures and their characteristic functions \(\widehat{\mu_n}\) satisfy \[ \widehat{\mu_n}(t)\to \widehat{\mu}(t)\quad \text{for all } t, \] under appropriate conditions this yields weak convergence. Likewise, moment conditions can help identify limits, but they do not automatically guarantee weak convergence unless additional assumptions (such as moment determinacy) are met.
1.3 Distinguishing weak convergence from other notions
Weak convergence sits between stronger and weaker modes. It is often easier to verify than norm convergence or uniform convergence, yet it preserves many structural features like convexity and compactness properties.
1.3.1 Strong convergence vs weak convergence
| Strong convergence in a normed space means \(\|x_n-x\|\to 0\). This implies weak convergence, since continuity of each \(f\in X^\*\) gives |
|---|
\[ f(x_n)-f(x)=f(x_n-x)\to 0. \] The converse generally fails: weak convergence may occur even when the vectors do not approach one another in norm.
1.3.2 Almost sure, in probability, and weak convergence (probabilistic context)
For random variables, one often has implications such as:
- almost sure convergence \(\Rightarrow\) convergence in probability;
- convergence in probability \(\Rightarrow\) convergence in distribution (weak convergence of laws).
However, convergence in distribution alone typically does not force almost sure behavior or even convergence in probability without extra conditions. Weak convergence of distributions therefore encodes distributional alignment rather than pathwise alignment.
1.3.3 Weak-* convergence and where it fits
Weak-* convergence is a related notion for the dual of a normed space. If \(X^\*\) is the dual space, then \((x_n^\*)\subset X^\*\) converges to \(x^\*\) in the weak-* sense if \[ x_n^\*(x)\to x^\*(x)\quad \text{for every } x\in X. \] This uses the predual \(X\) as the test family. Weak-* convergence is designed to interact well with compactness theorems and is especially useful in optimization and PDE.
2 Topologies and functional-analytic framework
Weak convergence is best understood through topology: it is convergence in a specific, generally weaker, topological structure induced by duality. This viewpoint clarifies which sequences converge and which theorems apply.
2.1 The weak topology on Banach spaces
Let \(X\) be a Banach space. The weak topology on \(X\) is defined so that all \(f\in X^\*\) are continuous. While the norm topology tracks sizes of vectors, the weak topology tracks only their “shadows” under dual pairings.
2.1.1 Definition via families of seminorms/functionals
A convenient description uses the fact that neighborhoods of a point can be built from finitely many functionals. For example, a typical weak neighborhood of \(x\) is determined by constraints of the form \[
| f_i(y-x) | <\varepsilon,\quad i=1,\dots,k, |
|---|
\] where \(f_i\in X^\*\). This reveals the topology as “generated” by these functional probes.
2.1.2 Topological properties (local convexity, Hausdorff)
The weak topology is locally convex because it arises from linear functionals. It is also Hausdorff: if \(x\neq y\), then by separation properties there exists \(f\in X^\*\) with \(f(x)\neq f(y)\), preventing sequences from becoming indistinguishable under all probes.
2.2 Dual spaces and weak-* topology
Duality changes which objects act as tests. Weak-* topology is constructed so that elements of the primal space act as probing devices.
2.2.1 Canonical pairing and definition
For a normed space \(X\), the canonical pairing between \(X\) and \(X^\*\) is evaluation: each \(f\in X^\*\) sends \(x\in X\) to \(f(x)\in \mathbb{F}\) (real or complex). Weak-* convergence of \(f_n\to f\) is defined by requiring convergence of these evaluations for each fixed \(x\in X\).
2.2.2 Banach–Alaoglu compactness and consequences
A central result is the Banach–Alaoglu theorem, which implies that the closed unit ball in \(X^\*\) is compact in the weak-* topology. This yields a powerful mechanism: bounded sequences in a dual space have weak-* convergent subnet subsequences. In many applications, one extracts limits from boundedness rather than from explicit formulas.
2.3 Metrizability and separability considerations
Weak topologies are often not metrizable. Whether one can speak about sequential compactness depends on structural properties like separability.
2.3.1 When weak convergence can be described by sequences
If the dual ball is metrizable in a certain topology, then compactness becomes sequential compactness. Metrizability can follow from separability assumptions, for example when \(X\) is separable and one restricts to certain weak-* compact subsets. In such cases, limits can often be achieved using sequences rather than more general nets.
2.3.2 Compactness and sequential compactness issues
In general, topological compactness in infinite-dimensional spaces does not guarantee existence of convergent subsequences in the usual sequential sense. Instead, one may need nets or subnets. This subtlety influences how proofs are organized, especially when extracting weak limits.
3 Fundamental theorems and criteria
Weak convergence comes with stability properties and criteria that enable rigorous limit passages. Many key theorems are tailored to convexity, semicontinuity, and compactness.
3.1 Lower semicontinuity and stability under weak limits
Many functionals relevant to analysis become weakly lower semicontinuous, meaning their value at the limit is bounded above by the liminf of the values along the sequence.
3.1.1 Convexity and weak lower semicontinuity
Convexity plays a decisive role: for suitable spaces, convex lower semicontinuous functionals with respect to the norm topology are also lower semicontinuous with respect to the weak topology. This principle underlies why energy-type functionals behave well under weak limits.
3.1.2 Applications to variational problems
In the calculus of variations, one seeks minimizers of an energy functional. A typical strategy is:
1 Definition and basic viewpoints
2 Topologies and functional-analytic framework
3 Fundamental theorems and criteria
4 Compactness, tightness, and existence of limits (probability)
This turns weak convergence from a mere definition into a practical tool for existence theory.
3.2 Mazur’s theorem and convex combinations
Weak convergence can be upgraded in an averaged sense. Mazur’s theorem states that if \(x_n\rightharpoonup x\) in a normed space, then one can form convex combinations of tail terms that converge to \(x\) in norm.
3.2.1 From weak convergence to norm convergence of averages
Concretely, there exist convex combinations of \(\{x_n,x_{n+1},\dots\}\) whose norms tend to \(0\) when subtracted from \(x\). This means that while individual terms may not converge strongly, appropriate mixtures do.
3.2.2 Implications for closure of convex sets
Mazur’s theorem implies that the weak closure of a convex set coincides with its norm closure. This is crucial in separating and compactness arguments, where one may only have weak limits available.
3.3 Banach–Saks property and related results
Another refinement concerns how averages behave under weak convergence. In certain spaces, weakly convergent sequences have subsequences whose Cesàro means converge in norm.
3.3.1 Cesàro means and norm convergence
The Banach–Saks property asserts that for a weakly convergent sequence in a Banach space, there exists a subsequence such that the arithmetic means of that subsequence converge in norm to the same weak limit. This connects weak convergence to strong convergence through averaging.
3.3.2 Uniformity and reflexive spaces
The Banach–Saks property is often found in reflexive settings and in spaces with geometric structure that controls how sequences behave. Reflexivity frequently appears because weak compactness and duality arguments become tractable.
3.4 Portmanteau-type results (probability measures)
For probability measures, weak convergence is equivalent to many other statements. These are often summarized under the name Portmanteau theorem, providing multiple characterizations that suit different proof techniques.
3.4.1 Equivalent characterizations using open/closed sets
One characterization uses inequalities for measures of open or closed sets. Roughly, under weak convergence, the limiting measure of closed sets is at least the limsup, and for open sets it is at most the liminf, reflecting how mass can “escape” in the limit.
3.4.2 Convergence of integrals for classes of functions
Other equivalent forms involve convergence of integrals for classes of functions broader than bounded continuous functions, such as bounded lower semicontinuous or bounded upper semicontinuous functions, under appropriate conditions. This flexibility helps when test functions are not perfectly continuous but retain semicontinuity.
4 Compactness, tightness, and existence of limits (probability)
In probability, the main challenge is to show that subsequential limits exist. Weak convergence of measures is closely tied to tightness, which controls how probability mass is distributed.
4.1 Tightness of probability measures
A family of probability measures is tight if for every \(\varepsilon>0\) there exists a compact set \(K\) such that each measure assigns probability at least \(1-\varepsilon\) to \(K\).
4.1.1 Prokhorov’s theorem
Prokhorov’s theorem states that on a Polish space (complete separable metric space), tightness is equivalent to relative compactness for weak convergence. In practice, tightness provides the criterion for extracting weakly convergent subsequences.
4.1.2 Criteria for tightness in practice
Tightness can be checked using tail bounds, moment bounds, or compactness of embeddings. For example, in \(\mathbb{R}^d\), showing that probability mass concentrates in large balls with high probability is often sufficient.
4.2 Tightness vs relative compactness
Tightness is the condition; weak convergence subsequences are the outcome. Relative compactness in the weak topology captures the existence of convergent subsequences without specifying the limit in advance.
4.2.1 Subsequence extraction arguments
Once tightness is established, one applies compactness results to obtain a subsequence (or, more generally, a subsequence in the relevant topology) that converges weakly. The exact extraction method depends on the underlying space and metrizability.
4.2.2 Weak limits and subsequences
Any weakly convergent subsequence produces a candidate limit measure. Different subsequences may lead to different limits if the original family is not convergent, but in many problems uniqueness of limits is shown by identifying the limit through moment conditions or characteristic functions.
4.3 Skorokhod representation theorem (conceptual use)
The Skorokhod representation theorem states that on suitable spaces, weak convergence of probability measures can be realized as almost sure convergence on a common probability space via a coupling. This is a conceptual aid because almost sure convergence supports pointwise-style arguments while preserving the original law.
4.3.1 Coupling viewpoint
Rather than working with measures directly, one constructs random variables \(X_n\) and \(X\) with distributions \(\mu_n\) and \(\mu\) such that \(X_n\to X\) almost surely. The underlying coupling makes the probabilistic meaning of weak convergence more tangible.
4.3.2 How it aids convergence proofs
Skorokhod’s theorem can simplify proofs that rely on almost sure convergence tools, such as dominated convergence in suitable contexts, while remaining consistent with an original weak convergence statement.
5 Convergence in weakly continuous operators
Weak convergence interacts naturally with operator theory: if an operator is continuous with respect to the weak topology, then applying it preserves convergence.
5.1 Weak continuity of linear and nonlinear maps
In many applications, operators describe how one transforms variables, e.g., from approximate solutions to limits.
5.1.1 Continuous linear operators preserve weak convergence
If \(T:X\to Y\) is a continuous linear operator between normed spaces, then \(x_n\rightharpoonup x\) in \(X\) implies \(Tx_n\rightharpoonup Tx\) in \(Y\). This follows because applying any functional on \(Y\) yields a functional on \(X\) through composition.
5.1.2 Weak continuity and demicontinuity
For nonlinear operators, one often uses weaker forms of continuity. A common example is demicontinuity, where strong convergence in the domain implies weak convergence in the codomain for the image under the operator. This is typical for monotone operators and nonlinear PDE frameworks, though verifying such properties depends on structure beyond general topology.
5.2 Composition rules and stability
Stability properties allow passing to limits inside operator expressions, particularly when operator outputs are tested against linear functionals.
5.2.1 Passing to limits under operator maps
If a map is weakly continuous and sequences converge weakly, then transformed sequences converge weakly as well. This is frequently used to show that limit objects satisfy weak formulations of equations.
5.2.2 Interchanging limits with functionals
A standard technique is to pair an operator output with a test functional and then pass to the limit using the definition of weak convergence. This “test against functionals” approach turns operator limit questions into scalar convergence problems.
6 Examples and non-examples
Examples clarify what weak convergence captures and where intuition can fail. Non-examples emphasize that weak convergence is not a substitute for stronger modes.
6.1 Canonical examples in Hilbert spaces
Hilbert spaces provide a concrete geometric setting where weak convergence often corresponds to “rotations” that escape strong limits.
6.1.1 Orthonormal sequences and weak limits
In a Hilbert space, an orthonormal sequence \((e_n)\) satisfies \(e_n \rightharpoonup 0\). Intuitively, each \(e_n\) stays at unit distance from the origin, but its inner product with any fixed vector tends to zero as the direction becomes increasingly orthogonal.
6.1.2 Weak convergence vs pointwise behavior
Weak convergence in Hilbert spaces does not imply pointwise convergence when the space is realized as functions. A sequence can converge weakly as elements of a function space while failing to converge pointwise or almost everywhere, because weak convergence ignores the behavior on individual points and instead tests against global probes.
6.2 Typical weakly convergent sequences
Weak convergence often occurs for bounded sequences in reflexive spaces, where weak compactness guarantees subsequential limits.
6.2.1 Bounded sequences in reflexive spaces
In a reflexive Banach space, bounded sequences have weakly convergent subsequences. Reflexivity ensures that closed bounded sets are weakly compact, enabling subsequence extraction.
6.2.2 Weakly convergent subsequences
Given boundedness, one can typically pass to a subsequence so that all dual pairings converge. This is a cornerstone in compactness methods: it converts boundedness estimates into existence of candidate limits.
6.3 Non-implications and counterexamples
Weak convergence is weaker than many other notions, and several failures are instructive.
6.3.1 Weak convergence does not imply norm convergence
| A sequence may converge weakly but stay away from the limit in norm. Orthonormal sequences are a standard example: even if \(e_n \rightharpoonup 0\), one still has \(\|e_n\|=1\), so \(\|e_n-0\|\not\to 0\). |
|---|
6.3.2 Weak convergence does not imply pointwise convergence
In function spaces like \(L^2\), weak convergence does not generally yield almost everywhere convergence. Oscillations and concentration effects can maintain the same global inner products while changing the pointwise behavior drastically.
7 Techniques for proving weak convergence
Proving weak convergence usually follows a pattern: reduce the claim to checking scalar limits against a manageable collection of probes, or extract subsequences using compactness and tightness arguments.
7.1 Test-function/functional method
This method is direct: verify convergence after pairing with tests.
7.1.1 Verifying convergence of pairings
To show \(x_n\rightharpoonup x\), one fixes \(f\in X^\*\) and proves \(f(x_n)\to f(x)\). In concrete settings, pairings translate into integrals or inner products that can be estimated and handled using standard limit theorems.
7.1.2 Reducing to dense sets of test functions
Instead of checking all functionals, one can often check convergence on a dense subset of the dual (in an appropriate sense). Linearity and continuity then extend the convergence to all tests. This reduces the workload in practice.
7.2 Compactness methods
When explicit pairing computations are difficult, compactness can supply convergent subsequences.
7.2.1 Extracting convergent subsequences
Boundedness in a reflexive space, or tightness for measures, leads to compactness in the relevant weak topology. One then selects a subsequence that converges weakly.
7.2.2 Using compactness of embeddings
In PDE and Sobolev space contexts, one leverages compact embeddings: while strong convergence in a smaller space may follow from boundedness, that strong convergence can imply weak convergence in a larger space. Conversely, weak convergence can be obtained from boundedness even when strong convergence is not available.
7.3 Tightness and moment bounds
In probabilistic problems, weak convergence proofs often reduce to showing tightness and identifying limit points.
7.3.1 Uniform integrability vs weak convergence (conceptual contrast)
Uniform integrability is a condition that controls expectations of unbounded observables and is more directly tied to convergence of integrals of functions that may grow. Weak convergence concerns bounded continuous test functions; thus, additional integrability assumptions are sometimes needed to pass to limits for unbounded observables.
7.3.2 Tail estimates for probability measures
Tail bounds—probability estimates of large deviations—are a practical route to tightness. Once tails are controlled uniformly in \(n\), compact sets capture most mass, enabling subsequence extraction via Prokhorov’s theorem.
8 Applications in analysis and PDE
Weak convergence is foundational in analysis and PDE because many compactness arguments produce only weak convergence, yet variational or weak formulations require only this level of convergence.
8.1 Variational methods and weak formulations
Variational problems naturally lead to weak formulations, which are stable under weak convergence.
8.1.1 Weak solutions and energy estimates
A weak solution is typically defined through an identity or inequality obtained after testing an equation against smooth functions. When approximate solutions are bounded in energy norms, one can extract weakly convergent subsequences and verify that the limit satisfies the weak formulation.
8.1.2 Compactness and weak limits in minimizing sequences
Minimizing sequences often converge weakly rather than strongly. Lower semicontinuity of the energy functional then ensures that the weak limit is a minimizer, or at least an admissible candidate achieving the infimum.
8.2 Evolution equations (abstract perspective)
For time-dependent problems, one often constructs approximations in time and passes to the limit in function spaces over time.
8.2.1 Weak convergence along time approximations
Discrete time schemes can yield sequences of approximations that are bounded in appropriate norms. Weak compactness then produces subsequential weak limits, which are shown to satisfy an evolution equation in a weak sense.
8.2.2 Passing to limits in nonlinear terms (general strategies)
Nonlinearities complicate limit passages because weak convergence alone may not allow direct substitution. Common strategies include:
- monotonicity methods,
- compactness improvements that upgrade weak convergence to stronger convergence in parts,
- identification of limits via compactness plus uniqueness of weak limits,
- use of compensated compactness in specific structures.
Which strategy applies depends heavily on the operator and the model.
8.3 Function space settings
Weak convergence is omnipresent in Sobolev and related spaces, where it interacts with derivatives and embeddings.
8.3.1 Sobolev spaces and weak convergence
In Sobolev spaces \(W^{k,p}\), weak convergence typically means convergence of functions together with convergence of their weak derivatives in the appropriate \(L^p\) sense. This is suited to PDE because derivatives may not exist pointwise for rough solutions.
8.3.2 Weak convergence in Hilbert and Banach scales
Hilbert space structure provides convenient tools like orthogonality and inner products, whereas Banach space settings require more general duality arguments. In both cases, weak convergence is the baseline for compactness and limit extraction.
9 Common extensions and related concepts
Weak convergence has several neighbors—other notions that either refine it, compare it, or provide alternative viewpoints such as distributional convergence.
9.1 Weak convergence in L^p spaces
In \(L^p\) spaces, weak convergence depends on reflexivity and on the duality pairing with \(L^q\), where \(1/p+1/q=1\).
9.1.1 Reflexivity ranges and boundedness
For \(1<p<\infty\), \(L^p\) spaces are reflexive, so bounded sequences admit weakly convergent subsequences. At endpoints (\(p=1\) or \(p=\infty\)), reflexivity fails, and weak compactness becomes more delicate.
9.1.2 Duality pairing and identifying limits
Weak convergence in \(L^p\) can be characterized by convergence of integrals against functions in the dual space. Specifically, \(f_n\rightharpoonup f\) in \(L^p\) means \[ \int f_n g \to \int f g \quad \text{for all } g\in L^q. \] This turns convergence into a family of scalar integral limits.
9.2 Weak convergence vs convergence in measure
Convergence in measure captures how often values differ substantially, but it is not the same as weak convergence.
9.2.1 When the two interact
Under additional uniform integrability or boundedness assumptions, convergence in measure plus uniform integrability can imply convergence of integrals of broad classes of functions, which can be related to weak convergence. In some structured settings, strengthened convergence can be derived via compactness or Vitali-type theorems.
9.2.2 Typical counterexamples
Weak convergence does not generally imply convergence in measure, and convergence in measure does not generally imply weak convergence without extra integrability or tightness controls. Oscillation and concentration effects can produce either behavior without the other.
9.3 Measure-theoretic and distributional viewpoints
In analysis, “weak” often means that convergence is tested against smooth compactly supported functions, leading to distribution theory.
9.3.1 Distributional convergence as a weak notion
A sequence of functions \(u_n\) can converge to \(u\) in the sense of distributions if \[ \int u_n \phi \to \int u \phi \quad \text{for all test functions } \phi, \] typically smooth with compact support. This is weak convergence with a specific choice of probes.
9.3.2 When weak convergence matches distributional limits
When functions belong to appropriate Sobolev spaces and weak convergence is established in those spaces, it often yields convergence in distributions as a consequence. Matching the two notions requires compatible regularity and convergence of derivatives in the weak sense.