Auto-generated summary from the source site. Handy as a checklist; the lessons above explain each idea from scratch.
Summary of Core Topics, Concepts, Principles, and Equations
1. Taylor Series Expansion
Concept: Approximating a function using an infinite sum of terms calculated from the values of its derivatives at a single point.
Equation: For f(x)=x1 around x=1:
f(x)≈1−(x−1)+(x−1)2−(x−1)3+(x−1)4
2. Eigenvalues and Eigenvectors
Concept: Eigenvalues are scalars associated with a linear transformation of a vector space, and eigenvectors are the corresponding vectors.
Equation: For a Hermitian matrix A, the eigenvalues λ satisfy det(A−λI)=0.
3. Schur's Theorem
Concept: Every square matrix is unitarily similar to an upper triangular matrix.
Principle: The diagonal entries of the Schur form are the eigenvalues of the matrix.
4. Gradient Descent
Concept: An optimization algorithm used to minimize some function by iteratively moving in the direction of steepest descent.
Equation: Update rules for gradient descent:
xnew=xold−η∂x∂f
ynew=yold−η∂y∂f
where η is the learning rate.
5. Singular Value Decomposition (SVD)
Concept: A factorization of a real or complex matrix, with applications in signal processing and statistics.
Equation: For a matrix M, SVD is given by:
M=Q1ΣQ2T
where Q1 and Q2 are unitary matrices, and Σ is a diagonal matrix with singular values.
6. Principal Component Analysis (PCA)
Concept: A statistical procedure that uses orthogonal transformation to convert a set of observations of possibly correlated variables into a set of values of linearly uncorrelated variables.
Equation: The covariance matrix C is given by:
C=n1i=1∑n(xi−xˉ)(xi−xˉ)T
where n is the number of data points, xi are the data points, and xˉ is the mean of the data points.
7. Positive Definite Matrices
Concept: A matrix is positive definite if it satisfies certain conditions related to its eigenvalues and quadratic forms.
Principle: All eigenvalues of a positive definite matrix are positive.