Register

GO Classes | DA Course| Machine Learning

178 views

1 Answer

1 1 vote
Solution: False. For example, if there aremultiple local minima, even two different runs of gradient descent may conyerge to different local minima, depending on the random initial condition. Adding on top of this the stochastic/randomness from stochastic gradient descent makes the statement definitely false.
Voting & Accepting an answer helps improve the community
Answer:
← Previous · GO Classes | DA Cour...Next → · GO Classes | DA Cour...
← Previous in category · GO Classes | DA Cour...Next in category → · GO Classes | DA Cour...
Position:
Show:

Related questions

0 0 votes
1 1 answer
239
239 views
GO Classes asked Mar 15, 2025
239 views
Go Classes | DA Course | Machine Learning
Consider the univariate function $f(x)=x^2$. This function has a unique minimum at $x^*=0$. We're using gradient descent (GD) to find this minimum and at time $t$ we arri...
0 0 votes
1 1 answer
163
163 views
GO Classes asked Mar 15, 2025
163 views
Go Classes | DA Course | Machine Learning
Suppose we run gradient descent with a fixed learning rate of $\alpha=0.1$ to minimize the 2D function $f(x, y)=5+x^2+y^2+5 x y$.The gradient of this function is$$\nabla_...
0 0 votes
0 0 answers
223
223 views
GO Classes asked Mar 15, 2025
223 views
GO Classes | DA Course| Machine Learning
Which of the following is not a true statement about gradient descent (GD) vs. stochastic gradient descent (SGD)?Both provide unbiased estimates of the true gradient at e...
0 0 votes
0 0 answers
224
224 views
GO Classes asked Mar 15, 2025
224 views
GO Classes | DA Course| Machine Learning
Suppose we are performing gradient descent to minimize the empirical risk of a linear regression model $y=\beta_0+\beta_1 x_1+\beta_2 x_1^2+\beta_3 x_2$ on a dataset with...