Setting 3, because it has the lowest training error, indicating the best fit to thetraining data.
Setting 2, because it has the lowest validation error and a relatively lowtraining error, indicating a good generalization.
Setting 1, because it has the highest number of iterations and therefore likelyto be more stable.
Setting 4, because it uses the highest learning rate and converges the fastest.
Q4MCQ3 marks
Q5MCQ2 marks
TRUE
FALSE
Q6MCQ1 mark
TRUE
FALSE
Q7MSQ2 marksselect all that apply
Q8MSQ2 marksselect all that apply
Which among the following are true?
Q9SA3 marks
Comprehension passage - the questions below it refer to this
Based on the above data, answer the given subquestions.
Q10MCQ3 marks
Which among the following represents the correct decision boundary for the decision tree?
Note: Here + represents the label 1 and − represents the label 0.
Q11SA2 marks
What will be the prediction for the new datapoint (2, 2)?
Comprehension passage - the questions below it refer to this
Based on the above data, answer the given subquestions.
Q12SA2 marks
Q13SA3 marks
Comprehension passage - the questions below it refer to this
Suppose you want to build a decision tree to help diagnose a certain disease based on patient data. You have a dataset of 1000 patients labeled as either “positive” or “negative”. Here, positive represents patients with the disease and negative represents no disease. One of the feature used to diagnose is headache. Below is the breakdown of the patients reporting headache: Headache present: 300 positive, 50 negative Headache not present: 100 positive, 550 negative
Suppose you want to build a decision tree to help diagnose a certain disease based on patient data. You have a dataset of 1000 patients labeled as either “positive” or “negative”. Here, positive represents patients with the disease and negative represents no disease. One of the feature used to diagnose is headache. Below is the breakdown of the patients reporting headache: Headache present: 300 positive, 50 negative Headache not present: 100 positive, 550 negative
Based on the above data, answer the given subquestions.
Q14SA3 marks
What is the entropy of the root node? Enter the answer correct to two decimal places.
Q15SA4 marks
What is the information gain for choosing the feature “headache” for splitting at the root node? Enter the answer correct to two decimal places.
Auto-generated summary from the source site. Handy as a checklist; the lessons above explain each idea from scratch.
Summary of Core Topics, Concepts, Principles, and Equations
1. Maximum Likelihood Estimation (MLE)
Concept: MLE is a method of estimating the parameters of a statistical model by maximizing the likelihood function.
Equation:
w^MLE=exp(n1i=1∑n(yi−log(xi)))
2. Maximum A Posteriori (MAP) Estimation
Concept: MAP estimation is a Bayesian approach to estimate parameters by finding the mode of the posterior distribution.
Equation:
w^MAP=argwmin{∥y−XTw∥2+λ∥w∥2}
λ=γ2
3. Linear Regression
Concept: Linear regression models the relationship between a dependent variable and one or more independent variables using a linear approach.
Equation:
y=wTx+ϵ
w∈Rdmin∣∣XTw−y∣∣22
4. Model Evaluation
Concept: Evaluating the performance of a model using metrics like training error and validation error.
Principle: Choose hyperparameters based on the lowest validation error and a relatively low training error.
5. Generative and Discriminative Models
Concept: Generative models learn the joint probability distribution P(x,y), while discriminative models learn the conditional probability distribution P(y∣x).
Principle: Generative models are interested in how the features are generated, while discriminative models focus on modeling P(y∣x).
6. Decision Trees
Concept: Decision trees are a non-parametric supervised learning method used for classification and regression.
Principle: Decision trees split the data based on features to create branches that lead to a decision.
Equation: Entropy and Information Gain
H(S)=−p+log2(p+)−p−log2(p−)
IG(S,A)=H(S)−v∈Values(A)∑∣S∣∣Sv∣H(Sv)
7. Naive Bayes Classifier
Concept: Naive Bayes is a probabilistic classifier based on applying Bayes' theorem with strong independence assumptions between the features.
Equation:
P(y∣x)=P(x)P(y)P(x∣y)
8. k-Nearest Neighbors (k-NN)
Concept: k-NN is a non-parametric method used for classification and regression.
Principle: The output is determined by the majority class or the average of the k-nearest neighbors.