Subsection CSSE Column Spaces and Systems of Equations

Theorem SLSLC showed us that there is a natural correspondence between solutions to linear systems and linear combinations of the columns of the coefficient matrix. This idea motivates the following important definition.

Definition CSM Column Space of a Matrix

Suppose that $A$ is an $m\times n$ matrix with columns $\vectorlist{A}{n}$. Then the column space of $A$, written $\csp{A}$, is the subset of $\complex{m}$ containing all linear combinations of the columns of $A$, \begin{equation*} \csp{A}=\spn{\set{\vectorlist{A}{n}}} \end{equation*}

Some authors refer to the column space of a matrix as the range, but we will reserve this term for use with linear transformations (Definition RLT).

Upon encountering any new set, the first question we ask is what objects are in the set, and which objects are not? Here is an example of one way to answer this question, and it will motivate a theorem that will then answer the question precisely.

Example CSMCS Column space of a matrix and consistent systems

So if we fix the coefficient matrix, and vary the vector of constants, we can sometimes find consistent systems, and sometimes inconsistent systems. The vectors of constants that lead to consistent systems are exactly the elements of the column space. This is the content of the next theorem, and since it is an equivalence, it provides an alternate view of the column space.

Theorem CSCS Column Spaces and Consistent Systems

Suppose $A$ is an $m\times n$ matrix and $\vect{b}$ is a vector of size $m$. Then $\vect{b}\in\csp{A}$ if and only if $\linearsystem{A}{\vect{b}}$ is consistent.

This theorem tells us that asking if the system $\linearsystem{A}{\vect{b}}$ is consistent is exactly the same question as asking if $\vect{b}$ is in the column space of $A$. Or equivalently, it tells us that the column space of the matrix $A$ is precisely those vectors of constants, $\vect{b}$, that can be paired with $A$ to create a system of linear equations $\linearsystem{A}{\vect{b}}$ that is consistent.

Employing Theorem SLEMM we can form the chain of equivalences \begin{align*} \vect{b}\in\csp{A} \iff \linearsystem{A}{\vect{b}}\text{ is consistent} \iff A\vect{x}=\vect{b}\text{ for some }\vect{x} \end{align*}

Thus, an alternative (and popular) definition of the column space of an $m\times n$ matrix $A$ is \begin{align*} \csp{A}&= \setparts{ \vect{y}\in\complex{m} }{ \vect{y}=A\vect{x}\text{ for some }\vect{x}\in\complex{n} } = \setparts{A\vect{x}}{\vect{x}\in\complex{n}} \subseteq\complex{m} \end{align*}

We recognize this as saying create all the matrix vector products possible with the matrix $A$ by letting $\vect{x}$ range over all of the possibilities. By Definition MVP we see that this means take all possible linear combinations of the columns of $A$ — precisely the definition of the column space (Definition CSM) we have chosen.

Notice how this formulation of the column space looks very much like the definition of the null space of a matrix (Definition NSM), but for a rectangular matrix the column vectors of $\csp{A}$ and $\nsp{A}$ have different sizes, so the sets are very different.

Given a vector $\vect{b}$ and a matrix $A$ it is now very mechanical to test if $\vect{b}\in\csp{A}$. Form the linear system $\linearsystem{A}{\vect{b}}$, row-reduce the augmented matrix, $\augmented{A}{\vect{b}}$, and test for consistency with Theorem RCLS. Here is an example of this procedure.

Example MCSM Membership in the column space of a matrix
Sage CSCS Column Space and Consistent Systems

Theorem CSCS completes a collection of three theorems, and one definition, that deserve comment. Many questions about spans, linear independence, null space, column spaces and similar objects can be converted to questions about systems of equations (homogeneous or not), which we understand well from our previous results, especially those in Chapter SLE. These previous results include theorems like Theorem RCLS which allows us to quickly decide consistency of a system, and Theorem BNS which allows us to describe solution sets for homogeneous systems compactly as the span of a linearly independent set of column vectors.

The table below lists these four definitions and theorems along with a brief reminder of the statement and an example of how the statement is used.

Definition NSM
SynopsisNull space is solution set of homogeneous system
Example General solution sets described by Theorem PSPHS
Theorem SLSLC
SynopsisSolutions for linear combinations with unknown scalars
Example Deciding membership in spans
Theorem SLEMM
SynopsisSystem of equations represented by matrix-vector product
Example Solution to $\linearsystem{A}{\vect{b}}$ is $\inverse{A}\vect{b}$ when $A$ is nonsingular
Theorem CSCS
SynopsisColumn space vectors create consistent systems
Example Deciding membership in column spaces

(in context)