What drives latency in an LLM application besides the model itself?

Instruction: Explain the major sources of latency outside raw model inference time.

Context: Checks whether the candidate can explain the core concept clearly and connect it to real production decisions. Explain the major sources of latency outside raw model inference time.