1 Definition and basic concepts
An invariant subspace is a linear subspace that is carried into itself by a linear transformation or operator. The idea is fundamental in linear algebra because it identifies parts of a vector space that can be studied separately from the rest. When such a subspace exists, the action of the operator on the whole space can often be understood through its action on the smaller, preserved piece.
1.1 Linear subspaces
A linear subspace is a subset of a vector space that is closed under vector addition and scalar multiplication. In other words, if two vectors belong to the set, then any linear combination of them also belongs to the set. Subspaces include familiar examples such as lines and planes through the origin in finite-dimensional spaces, as well as more abstract spaces of functions or sequences.
1.2 Linear operators and transformations
A linear transformation is a map between vector spaces that respects addition and scalar multiplication. When the domain and codomain are the same vector space, the map is often called a linear operator. Such maps can be represented by matrices once a basis is chosen, and their behavior is governed by algebraic properties that make invariant subspaces especially useful.
1.3 Invariance condition
A subspace is invariant under a linear operator if applying the operator to any vector in the subspace produces another vector in the same subspace. If T is an operator and W is a subspace, then W is invariant when T(W) is contained in W. This condition means that the operator does not move vectors outside the subspace.
1.3.1 Equivalent formulations
Several equivalent statements describe invariance. A subspace W is invariant under T if every vector in W is mapped back into W, if T restricted to W defines a linear operator on W, or if T(W) is a subset of W. In finite-dimensional settings, invariance can also be recognized by examining the block structure of a matrix relative to a basis adapted to the subspace.
1.3.2 Matrix representation
When a basis is chosen so that the first vectors span an invariant subspace, the matrix of the operator has a corresponding block upper triangular form. This representation makes the invariant structure visible in the matrix entries. The lower-left block is forced to vanish, reflecting the fact that vectors from the invariant subspace do not receive contributions from outside it.
1.4 Trivial and nontrivial invariant subspaces
Every operator has at least two trivial invariant subspaces: the zero subspace and the entire space. A nontrivial invariant subspace is one that is neither of these. The existence of nontrivial invariant subspaces often signals that the operator can be decomposed into simpler parts.
2 Examples
Examples help show how invariant subspaces appear in concrete settings. Some operators preserve obvious geometric subspaces, while others have more subtle invariant structures that are detected through algebraic or analytic methods.
2.1 Invariant subspaces of matrices
A matrix may preserve coordinate subspaces, eigenspaces, or spans of selected basis vectors. For instance, an upper triangular matrix preserves the subspace spanned by the first few standard basis vectors. Such examples are important because they show how matrix shape can encode invariance.
2.2 Invariant subspaces in finite-dimensional spaces
In finite-dimensional vector spaces, invariant subspaces are closely tied to eigenvalues, eigenvectors, and canonical forms. A diagonalizable operator has invariant subspaces generated by subsets of eigenvectors. More generally, generalized eigenspaces and Jordan blocks provide natural invariant subspaces that reflect the operator’s algebraic structure.
2.3 Invariant subspaces in infinite-dimensional spaces
In infinite-dimensional spaces, invariant subspaces may arise from shifts, multiplication operators, or differential operators. These cases are often more intricate than finite-dimensional examples because the geometry of the space can be much richer. Some operators have many invariant subspaces, while others are difficult to classify completely.
2.4 Common illustrative examples
A projection operator preserves both its image and its kernel. A shift operator on a sequence space preserves subspaces generated by tails of the sequence. Multiplication by a function on a function space often leaves invariant the subspaces of functions vanishing on specified sets or satisfying special support conditions.
3 Fundamental properties
Invariant subspaces behave well under several basic constructions. Their algebraic stability makes them useful for breaking operators into pieces and for transferring structure between a space and its quotients or orthogonal complements.
3.1 Sums and intersections
If a collection of subspaces is invariant under the same operator, then their intersection is also invariant. Under suitable conditions, their sum is invariant as well. These closure properties allow new invariant subspaces to be built from existing ones and support lattice-like organization of the family of all invariant subspaces.
3.2 Orthogonal complements
In spaces with an inner product, the orthogonal complement of an invariant subspace need not be invariant itself. However, if the subspace is reducing, then both the subspace and its orthogonal complement are invariant. This distinction is important in operator theory, where orthogonality interacts with adjoints and self-adjoint operators.
3.3 Quotient spaces
If W is invariant under T, then T induces a linear operator on the quotient space V/W. This induced action captures how T behaves modulo the subspace. Quotient spaces are therefore a natural way to study the operator after collapsing an invariant component.
3.4 Direct sum decompositions
When a vector space splits into a direct sum of invariant subspaces, the operator decomposes accordingly. In such cases, the matrix representation often becomes block diagonal or block triangular. This decomposition reduces a global problem to smaller independent problems on each summand.
4 Relation to eigenvalues and eigenvectors
Invariant subspaces are closely related to spectral ideas. Eigenvectors span one-dimensional invariant subspaces, and more elaborate spectral objects generate larger invariant pieces that reveal the fine structure of an operator.
4.1 Eigenspaces as invariant subspaces
An eigenspace corresponding to an eigenvalue is always invariant. If a vector lies in the eigenspace, the operator acts on it by simple scalar multiplication. This makes eigenspaces among the most elementary and important examples of invariant subspaces.
4.2 Generalized eigenspaces
Generalized eigenspaces extend the notion of eigenspaces by including vectors that are annihilated by a power of T minus a scalar multiple of the identity. These spaces are invariant and capture operators that are not fully diagonalizable. They play a central role in the decomposition of finite-dimensional operators.
4.3 Jordan form interpretation
In Jordan form, each Jordan block corresponds to an invariant subspace generated by a chain of generalized eigenvectors. The block structure shows how the operator acts by combining a scalar part with a nilpotent part. This interpretation makes invariant subspaces visible in the canonical matrix decomposition.
4.4 Diagonalizability and invariant subspaces
When an operator is diagonalizable, the space can be written as a direct sum of eigenspaces, each invariant on its own. If the operator is not diagonalizable, invariant subspaces still exist but may be arranged in more complicated chains. Thus diagonalizability is a strong form of reducibility by invariant subspaces.
5 Classification problems
Classifying invariant subspaces is often difficult and depends on the operator and the ambient space. In some settings, one seeks all invariant subspaces; in others, one studies those with special minimality or generation properties.
5.1 Reducible and irreducible operators
An operator is reducible if it has a nontrivial invariant subspace, and irreducible otherwise. Reducibility indicates that the operator can be decomposed into smaller components. Irreducible operators are more rigid and often harder to analyze because no proper invariant subspace simplifies the action.
5.2 Complete invariant subspace lattices
The set of all invariant subspaces of an operator can be organized as a lattice under inclusion, intersection, and sum. Describing this lattice completely is a major problem in linear algebra and operator theory. In favorable cases, the lattice has a clear structure; in others, it may be highly complicated.
5.3 Cyclic subspaces
A cyclic subspace is generated by repeatedly applying an operator to a single vector and taking the span of the resulting orbit. Such subspaces are automatically invariant. They are useful for reducing questions about an operator to the behavior of one generating vector.
5.4 Minimal invariant subspaces
A minimal invariant subspace is a nonzero invariant subspace containing no smaller nonzero invariant subspace. These are the building blocks of invariant-subspace decompositions. In finite-dimensional settings, minimal invariant subspaces are often linked to simple spectral factors or irreducible components.
6 Invariant subspaces in operator theory
Operator theory studies linear operators on infinite-dimensional spaces, where invariant subspaces are especially significant. Questions about existence and structure become deeper because analytic behavior and topological constraints enter the picture.
6.1 Bounded linear operators
For bounded linear operators on normed spaces, invariant subspaces interact with continuity and convergence. Many classical results in operator theory concern bounded operators on Hilbert or Banach spaces. The boundedness assumption helps ensure that the operator behaves well under limits and functional-analytic constructions.
6.2 Spectral implications
Invariant subspaces often reflect spectral properties of an operator. They may correspond to parts of the spectrum, spectral projections, or decompositions suggested by functional calculus. Conversely, knowledge of invariant subspaces can help localize and interpret spectral data.
6.3 The invariant subspace problem
The invariant subspace problem asks whether every bounded linear operator on a suitable infinite-dimensional space has a nontrivial invariant subspace. It became one of the most prominent questions in operator theory because of its broad implications for structure and decomposition.
6.3.1 Historical background
The problem emerged in the twentieth century from the development of functional analysis and the study of operators on Hilbert spaces. It drew sustained attention because finite-dimensional intuition does not always extend to infinite-dimensional settings. The question became a central test case for the depth of modern operator theory.
6.3.2 Known results
Many classes of operators are known to have nontrivial invariant subspaces, including numerous compact, compact-like, and spectral classes. Several major partial results established the existence of invariant subspaces under additional assumptions on the operator or the space. Nevertheless, a complete answer in full generality remains beyond the scope of the classical theory.
6.3.3 Special classes of operators
Certain operators, such as compact operators on infinite-dimensional Banach spaces, have well-understood invariant subspace behavior. Normal operators on Hilbert spaces also admit rich spectral decompositions that produce invariant subspaces. Other classes, including shifts and multiplication operators, are studied through more specialized tools.
7 Related constructions
Several constructions are closely connected to invariant subspaces even when they are not defined by invariance alone. These ideas help generate, compare, or strengthen invariant structure.
7.1 Invariant subspaces generated by a vector
Given a vector v, the smallest invariant subspace containing it is obtained by taking the span of all iterates of v under the operator. This construction is common in cyclic theory and is useful for understanding how much of the space can be reached from a single starting point.
7.2 Stable subspaces under powers of an operator
Some subspaces are invariant under an operator only after repeated application, or remain unchanged under powers of the operator. Such stability properties can reveal asymptotic or iterative behavior. They are especially relevant in discrete dynamical systems and nilpotent decompositions.
7.3 Common invariant subspaces for families of operators
A subspace may be invariant under several operators at once. Finding common invariant subspaces is important when studying commuting operators or operator algebras. Shared invariant structure can simplify simultaneous analysis and lead to joint decompositions.
7.4 Reducing subspaces
A reducing subspace is one that is invariant under both an operator and its adjoint. Reducing subspaces permit an orthogonal decomposition in which the operator splits cleanly into independent parts. They are stronger than ordinary invariant subspaces and are central in the study of normal and self-adjoint operators.
8 Applications
Invariant subspaces have applications across mathematics and related areas. They provide a method for simplifying complex linear actions and for isolating subsystems that evolve independently.
8.1 Matrix simplification
In matrix theory, invariant subspaces allow a matrix to be transformed into block triangular form. This can make it easier to compute powers, exponentials, determinants of related block forms, and spectral data. Such simplification is often the first step in deeper structural analysis.
8.2 Differential equations
In systems of linear differential equations, invariant subspaces correspond to collections of solutions that evolve without mixing with others. This can reduce a coupled system to smaller subsystems. The method is especially effective when the coefficient matrix has a decomposition aligned with its invariant subspaces.
8.3 Dynamical systems
For linear dynamical systems, invariant subspaces describe directions or modes preserved under iteration or flow. They help identify stable, unstable, and neutral behavior in linearized models. In discrete time, they are closely connected to repeated application of a matrix or operator.
8.4 Functional analysis
In functional analysis, invariant subspaces are used to study operators on spaces of functions and sequences. They support spectral decomposition, decomposition of representations, and the analysis of semigroups and integral operators. Their role is particularly important in problems where algebraic and topological methods meet.