Auto-generated summary from the source site. Handy as a checklist; the lessons above explain each idea from scratch.
Summary of Core Topics, Concepts, Principles, and Equations
1. Matrix Properties and Operations
Hermitian Matrix: A matrix equal to its conjugate transpose, B=BH.
Unitary Matrix: A matrix whose conjugate transpose is its inverse, AHA=AAH=I.
Determinant: A scalar value that can be computed from the elements of a square matrix and encodes certain properties of the linear transformation described by the matrix.
Trace: The sum of the elements on the main diagonal of a square matrix.
Eigenvalues and Eigenvectors: For a matrix A, the eigenvalues λ and eigenvectors v satisfy Av=λv.
Diagonalization: The process of finding a diagonal matrix similar to a given square matrix.
Singular Value Decomposition (SVD): A factorization of a real or complex matrix, A=UΣVT, where U and V are unitary matrices and Σ is a diagonal matrix.
2. Matrix Equations and Properties
Hermitian Matrix Equation: B=BH
Unitary Matrix Property: ∣α∣=1 for eigenvalues α of a unitary matrix.
Diagonalization Equation: A=QΛQT
SVD Equations: A=Q1ΣQ2T
3. Quadratic Forms and Gradient Descent
Quadratic Form: Q(x,y,z)=[xyz]Mxyz
Gradient Descent Algorithm: An optimization algorithm used to minimize some function by iteratively moving in the direction of steepest descent as defined by the negative of the gradient.
4. Principal Component Analysis (PCA)
Covariance Matrix: A matrix of covariances between elements of a dataset.
Eigenvalues of Covariance Matrix: Used to determine the principal components in PCA.
Projection onto Principal Components: The process of reducing the dimensionality of a dataset by projecting it onto the principal components.
5. Matrix Invertibility and Definiteness
Invertible Matrix: A matrix that has an inverse.
Singular Matrix: A matrix that does not have an inverse (determinant is zero).
Positive Definite Matrix: A matrix for which the associated quadratic form is always positive.
Positive Semi-Definite Matrix: A matrix for which the associated quadratic form is always non-negative.