What is Linear Algebra? | LA-101

The Language of Space

Linear algebra is the mathematics of lines, planes, and transformations. It powers everything from 3D graphics to machine learning. If calculus is the mathematics of change, linear algebra is the mathematics of structure — it gives us tools to describe and manipulate space mathematically.

At its core, linear algebra is about three things: vectors, matrices, and transformations. Vectors describe positions and directions. Matrices encode transformations. And the interplay between them lets us solve systems of equations, rotate 3D objects, compress images, and train neural networks.

Why "Linear"?

The word "linear" means that the operations we study respect two fundamental rules: adding things together and scaling things by constants. If you double the input, you double the output. If you add two inputs, the outputs add too. This simplicity is what makes linear algebra so powerful and so widely applicable.

f(ax + by) = a·f(x) + b·f(y) — The Principle of Linearity

Timeline — Key Milestones

1693

Leibniz introduces the concept of determinants for solving systems of equations

1750

Cramer publishes Cramer's Rule, a formula for solving linear systems using determinants

1844

Grassmann develops the theory of vector spaces and exterior algebra

1855
Cayley formalizes matrix algebra, introducing matrix multiplication and notation

Vectors: Direction and Magnitude

A vector is the most fundamental object in linear algebra. Think of it as an arrow with a direction and a length (magnitude). In two dimensions, a vector is simply a pair of numbers: the horizontal and vertical components.

Vectors can be added together (tip-to-tail) and scaled by numbers (stretched or shrunk). These two operations — addition and scalar multiplication — are the building blocks of everything in linear algebra. Any vector in 2D space can be expressed as a combination of the two standard basis vectors.

Vector in 2D

\mathbf{v} = \begin{bmatrix} x \\ y \end{bmatrix}

A vector is an ordered list of numbers describing a point or direction in space

Matrices: Transformations

A matrix is a rectangular grid of numbers. But it is much more than a table — a matrix represents a transformation. When you multiply a matrix by a vector, you transform that vector into a new one. Depending on the matrix, this could be a rotation, a scaling, a reflection, or a shear.

The beauty of matrices is that complex transformations can be composed by multiplying matrices together. A rotation followed by a scaling is just one matrix multiplication away. This is why computer graphics engines, physics simulations, and machine learning algorithms all rely heavily on matrix operations.

2×2 Matrix

\begin{bmatrix} a & b \\ c & d \end{bmatrix}

A 2×2 matrix transforms 2D vectors — the entries control rotation, scaling, and shear

Systems of Equations

One of the most important applications of linear algebra is solving systems of linear equations. When you have multiple equations with multiple unknowns, linear algebra gives you systematic methods to find solutions — or determine that no solution exists.

The equation Ax = b is the central problem of linear algebra. Here, A is a matrix of coefficients, x is the vector of unknowns, and b is the vector of results. Techniques like Gaussian elimination, matrix inversion, and factorization all address this fundamental problem.

The Central Problem

A\mathbf{x} = \mathbf{b}

Ax = b — find the vector x that, when transformed by A, produces b

Why Linear Algebra Matters

Linear algebra is not an abstract curiosity — it is the computational backbone of modern technology. Computer graphics use matrices for every frame rendered on your screen. Machine learning uses matrices to store and process data through neural networks. Physics uses vectors and matrices to describe forces, rotations, and quantum states.

Signal processing, statistics, optimization, robotics, and control theory all depend on linear algebra. If you want to understand how technology actually works under the hood, linear algebra is the language you need.

Linear Algebra in the Real World

Google PageRank ranks every webpage on the internet using an enormous matrix of link relationships and a linear algebra technique called eigenvalue decomposition. Image compression algorithms like JPEG use matrix decompositions to reduce file sizes while preserving visual quality.

Neural networks — the engines behind modern AI — are essentially sequences of matrix multiplications and nonlinear activations. And quantum computing describes the state of quantum bits using vectors and transforms them using matrices (called unitary operators).

In the next lesson, we will explore vectors in depth — how to add them, scale them, and understand their geometric meaning. You will learn about the dot product, projections, and why vectors are the foundation of everything in linear algebra.

Key Takeaways

Vectors represent direction and magnitude in space — they are the fundamental objects of linear algebra.
Matrices transform vectors — rotation, scaling, reflection, and more are all encoded as matrix operations.
Ax = b is the central problem of linear algebra — solving systems of equations is at the heart of the field.
Linear algebra is essential for computer graphics, machine learning, physics, engineering, and data science.