Geometric Interpretation | LA-101

From Numbers to Pictures

In the previous lesson, we met scalars, vectors, and matrices as collections of numbers. But linear algebra is not just about arithmetic — it is fundamentally geometric. Every vector can be drawn as an arrow. Every matrix can be visualized as a transformation. This lesson bridges the gap between algebra and geometry, giving you the visual intuition that makes the entire subject click.

Thinking geometrically does not replace calculation — it complements it. When you can see what an equation means as a picture, you can check your work, build intuition for new problems, and understand why formulas are the way they are.

Vectors as Arrows

The most fundamental geometric idea in linear algebra is this: a vector is an arrow. It has a tail (starting point) and a tip (ending point). The arrow's length represents its magnitude, and the direction it points represents its direction.

A 2D vector like (3, 2) means "go 3 units to the right and 2 units up." When we draw this with the tail at the origin, the tip lands at the point (3, 2). The arrow itself is the vector — not just the endpoint. Two arrows with the same length and direction are the same vector, regardless of where they start.

Position vs. Free Vectors

A position vector always starts at the origin and points to a specific location. A free vector can be placed anywhere — only its length and direction matter. In linear algebra, we usually work with free vectors, but draw them from the origin for convenience.

Coordinate Systems

To describe vectors precisely, we need a coordinate system. In 2D, we draw two perpendicular axes — horizontal (x) and vertical (y) — intersecting at the origin. Every point in the plane can be reached by a unique combination of horizontal and vertical displacements.

In 3D, we add a z-axis for depth. The components of a vector are simply the coordinates of its tip when the tail sits at the origin. This connection between algebra and geometry is what makes linear algebra so powerful: numbers become pictures, and pictures become numbers.

Vector Addition: The Parallelogram Rule

When you add two vectors, the geometry is elegant. The tip-to-tail rule says: place the tail of the second vector at the tip of the first. The sum is the arrow from the start of the first to the tip of the second.

Equivalently, the parallelogram rule says: place both vectors at the same starting point and complete the parallelogram. The diagonal is the sum. Both methods give the same result, and they reveal that vector addition is commutative: a + b = b + a, because the parallelogram is symmetric.

Vector Addition

\begin{bmatrix} a_1 \\ a_2 \end{bmatrix} + \begin{bmatrix} b_1 \\ b_2 \end{bmatrix} = \begin{bmatrix} a_1+b_1 \\ a_2+b_2 \end{bmatrix}

Component-wise addition — each component adds independently

Scalar Multiplication: Stretching and Shrinking

Scalar multiplication changes a vector's length without changing its direction. Multiply by 2, and the arrow doubles. Multiply by ½, and it halves. Multiply by −1, and the arrow flips direction while keeping the same length.

More generally, multiplying by a negative scalar both reverses direction and scales the length. The key insight: scalar multiplication slides the vector along its own line, stretching, shrinking, or flipping it.

Scalar Multiplication

c \begin{bmatrix} v_1 \\ v_2 \end{bmatrix} = \begin{bmatrix} cv_1 \\ cv_2 \end{bmatrix}

Every component scales by the same factor c

Magnitude: The Length of an Arrow

The magnitude (or norm) of a vector is the length of its arrow. For a 2D vector, this is just the Pythagorean theorem: the components form the legs of a right triangle, and the magnitude is the hypotenuse.

In n dimensions, you sum the squares of all components and take the square root. This formula, called the Euclidean norm, works in any number of dimensions.

Euclidean Norm

\|\mathbf{v}\| = \sqrt{v_1^2 + v_2^2 + \cdots + v_n^2}

The magnitude of a vector — the Pythagorean theorem generalized to n dimensions

Unit Vectors

A unit vector has magnitude exactly 1. It represents pure direction with no magnitude information. To create a unit vector from any nonzero vector, divide the vector by its own magnitude — a process called normalization.

The standard basis vectors î and ĵ (in 2D) are unit vectors pointing along the x and y axes. They form the reference directions for the entire coordinate system. Any vector can be written as a linear combination of these basis vectors.

Normalization

\hat{\mathbf{v}} = \frac{\mathbf{v}}{\|\mathbf{v}\|}

Dividing a vector by its magnitude produces a unit vector in the same direction

Dot Product: Projection and Alignment

The dot product of two vectors has a powerful geometric meaning. Algebraically, you multiply corresponding components and sum them. Geometrically, it equals the product of the two magnitudes times the cosine of the angle between them.

This formula reveals everything. When two vectors are perpendicular, the angle is 90°, cos(90°) = 0, so the dot product is zero. When they point in the same direction, the angle is 0°, cos(0°) = 1, and the dot product equals the product of their lengths. The dot product also gives us the projection of one vector onto another.

Dot Product (Algebraic)

\mathbf{a} \cdot \mathbf{b} = a_1 b_1 + a_2 b_2 + \cdots + a_n b_n

Sum of component-wise products

Dot Product (Geometric)

\mathbf{a} \cdot \mathbf{b} = \|\mathbf{a}\|\,\|\mathbf{b}\|\cos\theta

Magnitude times cosine of the angle

Cross Product: Area and Perpendicularity

The cross product is exclusive to 3D. Given two vectors a and b, their cross product produces a third vector that is perpendicular to both. The direction follows the right-hand rule, and the magnitude equals the area of the parallelogram formed by the two vectors.

When two vectors are parallel, their cross product is the zero vector — because a parallelogram with zero width has zero area. The cross product appears everywhere in physics: torque, angular momentum, and the magnetic force are all cross products.

Cross Product

\mathbf{a} \times \mathbf{b} = \begin{vmatrix} \hat{i} & \hat{j} & \hat{k} \\ a_1 & a_2 & a_3 \\ b_1 & b_2 & b_3 \end{vmatrix}

The determinant formula for the cross product

Cross Product Magnitude

\|\mathbf{a} \times \mathbf{b}\| = \|\mathbf{a}\|\,\|\mathbf{b}\|\sin\theta

Equals the area of the parallelogram

Linear Combinations & Span

A linear combination takes a set of vectors, multiplies each by a scalar, and adds the results. The span of a set of vectors is the collection of all possible linear combinations — it describes the reachable space.

Two non-parallel vectors in 2D span the entire plane: you can reach any point by choosing the right scalars. If the vectors are parallel, their span collapses to just a line. In 3D, three non-coplanar vectors span all of 3D space. This concept is at the heart of understanding dimension, basis, and rank.

Linear Combination

\mathbf{w} = c_1 \mathbf{v}_1 + c_2 \mathbf{v}_2 + \cdots + c_k \mathbf{v}_k

Any vector in the span can be written as a weighted sum of basis vectors

Visualizing Transformations

Here is where geometry and matrices truly unite. A matrix represents a linear transformation: a function that maps vectors to vectors while preserving addition and scalar multiplication. Geometrically, this includes rotations, reflections, scaling, and shearing.

The key insight: the columns of a matrix tell you where the basis vectors land after the transformation. A 2D rotation matrix sends î and ĵ to new positions, and every other vector follows. This single idea lets you visualize any matrix as a geometric operation.

2D Rotation Matrix

R(\theta) = \begin{bmatrix} \cos\theta & -\sin\theta \\ \sin\theta & \cos\theta \end{bmatrix}

Rotates every vector by angle θ counterclockwise around the origin

In the next lesson, we will explore vector spaces and linear independence — the formal rules that govern how vectors combine and the concept of dimension that emerges from those rules.

Key Takeaways

Vectors are arrows with direction and magnitude — not just lists of numbers.
Vector addition follows the parallelogram rule; scalar multiplication stretches or shrinks along the arrow's line.
The magnitude (Euclidean norm) is the generalized Pythagorean theorem; unit vectors capture pure direction.
The dot product measures alignment between vectors via the cosine of the angle between them.
The cross product (3D only) produces a perpendicular vector whose magnitude equals the parallelogram area.
The span of a set of vectors is the reachable space — the foundation of dimension and basis.
Matrices are geometric transformations; their columns show where basis vectors land.