🧚🏽‍♀️Abstract Linear Algebra I Unit 4 – Matrix Operations & Invertibility

Key Concepts

• Matrices represent linear transformations and systems of linear equations
• Matrix operations include addition, subtraction, scalar multiplication, and matrix multiplication
• The determinant of a square matrix is a scalar value that provides information about the matrix's invertibility and the volume scaling factor of the linear transformation it represents
• A matrix is invertible if and only if its determinant is non-zero
• The inverse of a matrix $A$, denoted as $A^{-1}$, is a unique matrix such that $AA^{-1} = A^{-1}A = I$, where $I$ is the identity matrix
• Gaussian elimination is a method for solving systems of linear equations and finding the inverse of a matrix
• Cramer's rule is a formula for solving systems of linear equations using determinants
• The rank of a matrix is the maximum number of linearly independent rows or columns in the matrix

Matrix Basics

• A matrix is a rectangular array of numbers arranged in rows and columns
• The size of a matrix is described by its number of rows and columns, denoted as $m \times n$, where $m$ is the number of rows and $n$ is the number of columns
• The entries of a matrix are typically denoted using lowercase letters with subscripts indicating their position, such as $a_{ij}$ for the entry in the $i$-th row and $j$-th column
• Matrices are equal if and only if they have the same size and corresponding entries are equal
• The transpose of a matrix $A$, denoted as $A^T$, is obtained by interchanging the rows and columns of $A$
  • For example, if $A = \begin{bmatrix} 1 & 2 \\ 3 & 4 \end{bmatrix}$, then $A^T = \begin{bmatrix} 1 & 3 \\ 2 & 4 \end{bmatrix}$
• The main diagonal of a square matrix consists of the entries $a_{ii}$, where $i = 1, 2, \ldots, n$
• The trace of a square matrix is the sum of the entries on its main diagonal

Types of Matrices

• A square matrix has an equal number of rows and columns
• An identity matrix, denoted as $I_n$, is a square matrix with 1s on the main diagonal and 0s elsewhere
• A diagonal matrix is a square matrix with non-zero entries only on the main diagonal
• A scalar matrix is a diagonal matrix with all diagonal entries equal to the same scalar value
• A symmetric matrix is equal to its transpose, i.e., $A = A^T$
• A skew-symmetric matrix is equal to the negative of its transpose, i.e., $A = -A^T$
• An upper triangular matrix has all entries below the main diagonal equal to zero
• A lower triangular matrix has all entries above the main diagonal equal to zero

Matrix Operations

• Matrix addition and subtraction are performed element-wise and require matrices of the same size
  • For example, if $A = \begin{bmatrix} 1 & 2 \\ 3 & 4 \end{bmatrix}$ and $B = \begin{bmatrix} 5 & 6 \\ 7 & 8 \end{bmatrix}$, then $A + B = \begin{bmatrix} 6 & 8 \\ 10 & 12 \end{bmatrix}$
• Scalar multiplication of a matrix is performed by multiplying each entry of the matrix by the scalar
• Matrix multiplication is a binary operation that produces a matrix from two matrices
  • The product $AB$ is defined if and only if the number of columns in $A$ equals the number of rows in $B$
  • If $A$ is an $m \times n$ matrix and $B$ is an $n \times p$ matrix, then the product $AB$ is an $m \times p$ matrix
• Matrix multiplication is associative and distributive, but not commutative
• The power of a square matrix $A$, denoted as $A^n$, is the product of $A$ with itself $n$ times

Determinants

• The determinant is a scalar value associated with a square matrix
• For a $2 \times 2$ matrix $A = \begin{bmatrix} a & b \\ c & d \end{bmatrix}$, the determinant is given by $\det(A) = ad - bc$
• For larger matrices, the determinant can be calculated using cofactor expansion or Laplace expansion
• The determinant has several important properties:
  • $\det(AB) = \det(A) \cdot \det(B)$
  • $\det(A^T) = \det(A)$
  • If two rows or columns of a matrix are interchanged, the determinant changes sign
  • If a matrix has a row or column of zeros, its determinant is zero
• The determinant can be used to find the area of a parallelogram or the volume of a parallelepiped in higher dimensions

Matrix Invertibility

• A square matrix $A$ is invertible (or non-singular) if there exists a matrix $B$ such that $AB = BA = I$
• The matrix $B$ is called the inverse of $A$ and is denoted as $A^{-1}$
• A matrix is invertible if and only if its determinant is non-zero
• The inverse of a matrix can be found using the adjugate matrix and the determinant:
  • $A^{-1} = \frac{1}{\det(A)} \cdot \text{adj}(A)$
  • The adjugate matrix is the transpose of the cofactor matrix
• If a matrix is invertible, its inverse is unique
• The inverse of a product of matrices is the product of their inverses in reverse order: $(AB)^{-1} = B^{-1}A^{-1}$

Applications

• Matrices are used to represent and solve systems of linear equations
  • For example, the system $\begin{cases} 2x + 3y = 5 \\ 4x - y = 3 \end{cases}$ can be represented as $\begin{bmatrix} 2 & 3 \\ 4 & -1 \end{bmatrix} \begin{bmatrix} x \\ y \end{bmatrix} = \begin{bmatrix} 5 \\ 3 \end{bmatrix}$
• Matrices can represent linear transformations, such as rotations, reflections, and shears
• Markov chains use stochastic matrices to model systems that transition between states
• Computer graphics and image processing heavily rely on matrix operations for transformations and filtering
• Quantum mechanics represents the state of a quantum system using matrices called density matrices

Common Mistakes

• Not checking if matrix operations are valid for the given matrices (e.g., adding matrices of different sizes or multiplying matrices with incompatible dimensions)
• Confusing the order of matrix multiplication, as it is not commutative
• Forgetting to transpose a matrix when necessary, such as when calculating the dot product or solving certain matrix equations
• Incorrectly calculating the determinant, especially when using cofactor expansion or Laplace expansion
• Attempting to find the inverse of a non-invertible matrix (i.e., a matrix with a determinant of zero)
• Misinterpreting the meaning of the determinant in the context of the application
• Not properly applying the properties of determinants or matrix operations when simplifying expressions or solving problems