How does Transfer Learning impact the need for data augmentation in the target task?
Instruction: Discuss whether and how transfer learning affects the use of data augmentation techniques in the training process.
Context: Candidates should address the interplay between the richness of pre-trained models and the need for expanding or adjusting the target dataset, showcasing their practical knowledge of data handling.
Updated
Official answer available
Read the opening below, then unlock the full answer and practical guidance.
Pretraining can supply useful invariances, but it does not determine how much augmentation the target needs. Check which transformations preserve the target label and resemble relevant deployment variation...