What is the significance of the learning rate in gradient descent?
Instruction: Discuss how the learning rate affects the convergence of gradient descent.
Context: This question tests the candidate's knowledge of the gradient descent optimization algorithm, particularly the role of the learning rate in achieving convergence to a minimum.
Updated
Official answer available
Read the opening below, then unlock the full answer and practical guidance.
The way I'd explain it in an interview is this: The learning rate controls how large each parameter update is during optimization, and that makes it one of the most important knobs in training...