How would you reason about cold starts, warm pools, and steady-state traffic?

Instruction: Explain how you think about startup latency and traffic patterns in a serving system.

Context: Checks whether the candidate can explain the core concept clearly and connect it to real production decisions. Explain how you think about startup latency and traffic patterns in a serving system.