At Pinterest, we use Apache Flink for streaming applications, powering various use cases like real-time metrics reporting for ads from external advertisers and real-time ad budget calculations to optimize ad spend. Ensuring our Flink applications are high-performing and resilient is crucial for us. However, processing petabytes of data in stateful applications with low latency and high throughput is no walk in the park. Through our experiences and a few battle-scars, we’ve picked up some valuable lessons. In this talk, we’ll share those insights to help you scale your streaming applications with Apache Flink to handle internet-scale challenges.
