Recent questions tagged machine-learning

Which of the following statement(s) is(are) true for k-NN ?A. k represents the number of classes.B. The final outcome of the algorithm may change with the distance measur...

Why is it important to use a different test set to evaluate the final performance of the model, rather than the validation set used during model selection?A. The model ma...

Aman and Ed built a model on their data with two regularization hyperparameters $\lambda$ and $\gamma$. They have 4 good candidate values for $\lambda$ and 3 possible val...

Consider a nearest neighbor classifier that chooses the label for a test point to be the label of its nearest neighboring training example. What is its leave-oneout cross...

Suppose we have a design matrix $\mathbb{X}$ comprising of $n$ observations, $d$ features, and an additional intercept term. We decide to use $\mathbb{X}$ to create, tune...

Random forest is created from a number of decision trees, with each decision tree created from a bootstrapped version of the original training set. One hyperparameter of ...

Leave-one-out cross-validation (LOOCV) is a special case of k -fold cross-validation where:The training set contains all but one sample, and the remaining sample is used ...

Assume we have a data matrix $X$. Which of the following is a true statement when comparing leave-one-out cross validation (LOOCV) error with the true error? LOOCV error ...

$k$-fold cross-validation with $k=100$ is computationally more expensive (slower) than "leave-one-out" cross validation. (Assume that there are enough data points to divi...

Suppose we use leave-one-out cross validation meaning we use 7 -fold cross validation with a split of 6 to 1 between training set and validating set. Compute the average ...

Suppose we have $m$ data points in our training set and $n$ data points in our test set. In leave-one-out cross validation, we only use one data point for validation whil...

To prevent overfitting of our linear model, we would apply regularization on the model. Which of the following datasets should we evaluate using our model in order to dec...