Instruction: Describe the gradient descent algorithm and its role in machine learning.
Context: This question assesses the candidate's knowledge of optimization algorithms, specifically gradient descent, and its application in training models.
Official answer available
Preview the opening of the answer, then unlock the full walkthrough.
The way I'd explain it in an interview is this: Gradient descent is the basic process of improving a model by repeatedly moving its parameters in the direction that reduces the loss. At each step, you compute how the loss changes with respect...