Which among the following is true with respect to the Lloyds’ algorithm?
It always converges.
It may fail to converge for an initialization while it may converge for otherinitialization.
It is sensitive to outliers.
The solution produced is always the optimal.
Q2MSQ4 marksselect all that apply
There will be 50 non-zero eigenvalues of the covariance matrix.
There will be 6 non-zero eigenvalues of the covariance matrix.
Using the first 5 principal components, the dataset can be reconstructed withzero residue.
The variance captured by the top 6 principal components equals the totalvariance of the dataset.
Q3MSQ4 marksselect all that apply
The points (0, 2), (2, 0), and (2, 2) have the equal probability of being chosen asthe second cluster center.
The probability of selecting (2, 2) as the second cluster center is twice that ofselecting (0, 2).
If (2, 2) is chosen as the second cluster center, the algorithm will alwaysconverge in one iteration.
The tie-breaking rule will affect the final cluster centers.
Q4MSQ4 marksselect all that apply
Posterior mean for Beta(1, 1) is 0.039.
Posterior mean for Beta(1, 1) is 0.03.
Posterior mean for Beta(0.5, 0.5) is 0.025.
Posterior mean for Beta(0.5, 0.5) is 0.034.
Q5MSQ3 marksselect all that apply
Which of the following are valid kernel functions? Select all that apply.
Q6SA3 marks
Q7SA3 marks
Comprehension passage - the questions below it refer to this
Based on the above data, answer the given subquestions.
Q8MCQ2 marks
What is the covariance matrix of the dataset?
Q9SA2 marks
If standard PCA is performed on this dataset, what is the variance along the first principal component? Enter the answer correct to one decimal place.
Q10SA2 marks
If standard PCA is performed on this dataset, what is the variance along the second principal component? Enter the answer correct to one decimal place.
Comprehension passage - the questions below it refer to this
Based on the above data, answer the given subquestions.
Q11MCQ3 marks
Q12SA3 marks
Comprehension passage - the questions below it refer to this
Based on the above data, answer the given subquestions.
Q13MCQ3 marks
Perform K-means clustering with K = 2 and initial cluster centers at (−2, 3) and (2,−1). What are the final means of clusters after convergence?
Q14SA2 marks
Suppose we introduce a new data point (0, 0) to the existing dataset and perform K means with the same initial cluster centers. How many iterations would it require now for convergence?
Auto-generated summary from the source site. Handy as a checklist; the lessons above explain each idea from scratch.
Here’s a structured summary of core topics, concepts, principles, and equations essential for the exam, followed by Mermaid knowledge graphs to visualize relationships.
Core Topics & Key Concepts
1. Clustering (K-Means & Lloyd’s Algorithm)
Lloyd’s Algorithm (K-Means):
Convergence: Always converges (monotonically decreases objective function), but may converge to local optima (depends on initialization).
Sensitivity: Sensitive to outliers (uses Euclidean distance).
Optimality: Does not guarantee global optimum (only local).
Initialization: Affects final clusters (e.g., k-means++ improves initialization).
Steps:
Initialize centroids randomly.
Assign points to nearest centroid.
Recompute centroids as mean of assigned points.
Repeat until convergence (no change in assignments).
Tie-Breaking: Affects final clusters if points are equidistant to centroids.
Probability of Centroid Selection:
If using random initialization, probability of selecting a point as the second centroid is proportional to its squared distance from the first centroid (used in k-means++).
2. Principal Component Analysis (PCA)
Key Ideas:
Linear dimensionality reduction via orthogonal transformation.
Projects data onto directions (principal components) of maximum variance.
Components are eigenvectors of the covariance matrix, ordered by eigenvalues (variance explained).
Covariance Matrix:
For a dataset X∈Rn×d (centered), covariance matrix Σ=n−11XTX.
Eigenvalues: Number of non-zero eigenvalues = rank of Σ (≤ min(n, d)).
Total Variance: Sum of all eigenvalues = trace of Σ.
Reconstruction:
Using top k components, residual error = sum of discarded eigenvalues.
Zero residue: Only if k=rank(Σ).
Variance Explained:
Variance along i-th PC = λi (eigenvalue).
Proportion of variance: ∑jλjλi.
Example (from Q3, Q9–Q11):
If covariance matrix has eigenvalues [4.5,0.5,0,…]:
Variance along PC1 = 4.5, PC2 = 0.5.
Total variance = 5.0 (sum of all eigenvalues).
3. Bayesian Inference (Beta Distribution)
Beta Distribution:
Prior for binary outcomes (e.g., coin flips): Beta(α,β).
Posterior Mean: For Beta(α,β), mean = α+βα.
Update Rule: After observing s successes and f failures, posterior is Beta(α+s,β+f).
Example (from Q5):
Prior Beta(1,1) (uniform), observe 1 success in 25 trials:
Posterior = Beta(2,26), mean = 282≈0.039.
Prior Beta(0.5,0.5), same data:
Posterior = Beta(1.5,25.5), mean = 271.5≈0.034.
4. Kernel Methods
Valid Kernel Functions (from Q6):
Must satisfy Mercer’s condition (positive semi-definite Gram matrix).
Examples:
Linear kernel: K(x,y)=xTy.
Polynomial kernel: K(x,y)=(xTy+c)d.
Gaussian (RBF) kernel: K(x,y)=exp(−γ∥x−y∥2).
Sigmoid kernel: K(x,y)=tanh(αxTy+c).
5. K-Means Practical Examples
Convergence Iterations (from Q14–Q15):
With initial centroids at (−2,3) and (2,−1), K-means converges in 1 iteration for the given dataset (points are clearly separable).
Adding (0,0) may require 1 iteration if assignments don’t change.