Recent questions tagged machine-learning

In LASSO regression, if the regularization parameter $\lambda$ is very large and two informative featuresare highly collinear (i.e., that there exists an $\alpha$ such th...

Please assign each plot in Figure above to one (and only one) of the following regularization methods. Please answer A , B, C or D for each statements.No regularization ...

Let $x \in \mathbb{R}^n$ be the data matrix and $y \in \mathbb{R}^{n \times d}$ be the observed labels for the $n$ examples. Let $w \in \mathbb{R}^d$ be the weight parame...

Suppose we are minimizing $J^{\prime}(\boldsymbol{\theta})$ where$$J^{\prime}(\boldsymbol{\theta})=J(\boldsymbol{\theta})+\lambda r(\boldsymbol{\theta})$$As $\lambda$ inc...

Which of the following is not a true statement about gradient descent (GD) vs. stochastic gradient descent (SGD)?Both provide unbiased estimates of the true gradient at e...

Suppose we are performing gradient descent to minimize the empirical risk of a linear regression model $y=\beta_0+\beta_1 x_1+\beta_2 x_1^2+\beta_3 x_2$ on a dataset with...

Convexity is a desirable property in machine learning because it:guarantees gradient descent finds a global minimum in optimization problems for functions that have a glo...

Which of the following are true about gradient descent? (select all statements that are true.)After each iteration, we modify the weight vector in the direction of the gr...

Consider the following function of $f(\theta)$, which alternates between completely flat regions and regions of absolute slope equal to 1 . For each of the following ques...

For the dataset $\mathcal{D}=\left\{\left(x_i, y_i\right)\right\}_{i=1}^n$ and the loss function:$$L(w)=\frac{1}{n} \sum_{i=1}^n\left(y_i-\sin \left(w_0+w_1 x_i\right)\ri...

The learning rate can potentially affect which of the following? Select all that apply. Assume nothing about the function being minimized other than that its gradient exi...