How would you approach the challenge of catastrophic forgetting in Transfer Learning?
Instruction: Explain the concept of catastrophic forgetting and discuss strategies to mitigate its effects during the Transfer Learning process.
Context: The question tests the candidate's knowledge of a critical issue in Transfer Learning and their ability to implement strategies to prevent it, ensuring the robustness of the transferred model.
Updated
Official answer available
Read the opening below, then unlock the full answer and practical guidance.
I would approach catastrophic forgetting by controlling how aggressively the pretrained model is updated...