Instruction: Explain what layer freezing is, its benefits, and its potential drawbacks in the context of Transfer Learning.
Context: Candidates must demonstrate understanding of techniques to optimize training in Transfer Learning, including how layer freezing affects model adaptation and computational resources.
Official answer available
Preview the opening of the answer, then unlock the full walkthrough.
The way I'd explain it in an interview is this: Layer freezing improves efficiency because fewer parameters are updated, which lowers compute and often stabilizes training. It can also protect useful pretrained features when the target...