Instruction: Discuss the potential benefits and drawbacks of applying deep pre-trained models to new tasks.
Context: Candidates must weigh the complexity and capabilities of deep models against computational resources and task specificity, showing their strategic thinking in model selection.
Official answer available
Preview the opening of the answer, then unlock the full walkthrough.
The way I'd explain it in an interview is this: Very deep pretrained models can provide strong representations, but they also increase cost, memory pressure, latency, and the risk of overfitting small target datasets. They are powerful, but...
medium
hard
hard