IIT M DIPLOMA AN EXAM QDD2 01 Dec 2024 - 01 Dec 2024

Concepts this paper tests

Auto-generated summary from the source site. Handy as a checklist; the lessons above explain each idea from scratch.

Summary of Core Topics, Concepts, Principles, and Equations

Linear Algebra

1. Matrices and Their Properties

   • Hermitian Matrix: A matrix equal to its conjugate transpose, $B = B^H$.
   • Unitary Matrix: A matrix whose conjugate transpose is its inverse, $A^{-1} = A^H$.
   • Diagonalization: Expressing a matrix in the form $A = Q \Lambda Q^T$, where $\Lambda$ is a diagonal matrix.
   • Singular Value Decomposition (SVD): Expressing a matrix as $A = Q_1 \Sigma Q_2^T$.

1. Eigenvalues and Eigenvectors

   • Eigenvalues: Scalars $\lambda$ such that $Av = \lambda v$ for a non-zero vector $v$.
   • Eigenvectors: Non-zero vectors $v$ that satisfy $Av = \lambda v$.
   • Properties: For unitary matrices, eigenvalues have magnitude 1, $|\alpha| = 1$.

1. Quadratic Forms and Covariance Matrices

   • Quadratic Form: $Q(x, y, z) = x^T M x$.
   • Covariance Matrix: Used in Principal Component Analysis (PCA) to project data onto lower-dimensional spaces.

1. Matrix Types and Properties

   • Square Matrix: A matrix with the same number of rows and columns.
   • Diagonal Matrix: A matrix with non-zero elements only on the main diagonal.
   • Upper/Lower Triangular Matrix: Matrices with zero elements below or above the main diagonal.
   • Singular Matrix: A matrix with a determinant of zero, which is not invertible.
   • Positive Semi-Definite Matrix: A matrix whose eigenvalues are non-negative.

Optimization

1. Gradient Descent

   • Algorithm: Iterative method to minimize a function $f(x, y)$.
   • Learning Rate: Step size in the gradient descent algorithm, often denoted as $\frac{1}{t^2}$.

1. Projection and Distance

   • Projection: Finding the closest point on a line to a given point.
   • Distance: Minimizing the distance between a point and a line.

Principal Component Analysis (PCA)

1. Covariance Matrix: Used to understand the variance and covariance of data.
2. Eigenvalues and Eigenvectors: Used to determine the principal components.
3. Projection: Projecting data onto the principal components to reduce dimensionality.

Equations

1. Eigenvalue Equation:

1. Diagonalization:

1. Singular Value Decomposition (SVD):

1. Quadratic Form:

1. Gradient Descent Update:

1. Projection onto a Line: