Design a scalable NLP pipeline for processing real-time social media streams.
Instruction: Outline the architecture and key components of an NLP system capable of analyzing large volumes of social media data in real-time.
Context: Candidates must showcase their ability to design efficient, high-performance NLP systems that can handle dynamic, unstructured data at scale.
Updated
Official answer available
Read the opening below, then unlock the full answer and practical guidance.
I would design the pipeline around ingestion, normalization, lightweight filtering, enrichment, model inference, and monitoring...