IIT M IMPROVEMENT AN EXAM QIC2 03 Aug - 03 Aug 2025

Concepts this paper tests

Auto-generated summary from the source site. Handy as a checklist; the lessons above explain each idea from scratch.

Summary of Core Topics and Concepts

1. Optimization and Critical Points

• Gradient and Hessian Matrix:

  • Gradient ($\nabla f$): Vector of partial derivatives.
  • Hessian Matrix ($\nabla^2 f$): Matrix of second-order partial derivatives.
  • Key Concept: If $\nabla f(x^*) = 0$ and $\nabla^2 f(x^*) > 0$, then $x^*$ is a local minimum.

• Quadratic Forms:

  • Key Concept: A quadratic form $Q(x, y, z)$ can be positive definite, negative definite, or indefinite.
  • Equation: $Q(x, y, z) = x^2 + 2xy - 2xz$

2. Matrix Properties

• Positive Definite and Semi-Definite Matrices:

  • Key Concept: A matrix $A$ is positive definite if $x^T A x > 0$ for all non-zero $x$.
  • Equation: For a matrix $A$, check the eigenvalues or principal minors.

• Eigenvalues and Eigenvectors:

  • Key Concept: Eigenvalues and eigenvectors are crucial for understanding matrix properties.
  • Equation: $A v = \lambda v$, where $\lambda$ is an eigenvalue and $v$ is the corresponding eigenvector.

3. Singular Value Decomposition (SVD)

• Key Concept: SVD decomposes a matrix $A$ into $A = Q_1 \Sigma Q_2^T$.

  • Equations:

    • $A = Q_1 \Sigma Q_2^T$
    • $\Sigma$ is a diagonal matrix of singular values.
    • $Q_1$ and $Q_2$ are orthogonal matrices.

4. Principal Component Analysis (PCA)

• Key Concept: PCA is used for dimensionality reduction.

  • Equations:

    • Covariance matrix $C = \frac{1}{n-1} X^T X$
    • Eigenvalues and eigenvectors of the covariance matrix.

5. Gradient Descent

• Key Concept: Iterative optimization algorithm to find the minimum of a function.

  • Equation: $x_{k+1} = x_k - \eta \nabla f(x_k)$, where $\eta$ is the learning rate.

6. Hermitian and Unitary Matrices

• Key Concept: Hermitian matrices have real eigenvalues and orthogonal eigenvectors.

  • Equation: $A = A^H$ (Hermitian condition).