SESSION ON-DEMAND

All Things P99

The event for developers who care about P99 percentiles and high-performance, low-latency applications

Taming P99 Latencies at Lyft: Tuning Low-Latency Online Feature Stores

In this talk, we will explore the challenges and strategies of tuning low latency online feature stores to tame the p99 latencies, shedding light on the importance of choosing the right data model. As modern machine learning applications require increasingly fast and efficient feature retrieval/computation, addressing p99 latencies has become a crucial aspect in maintaining system performance and user satisfaction.

We will begin by defining p99 latencies and their impact on online feature stores. We will then delve into common issues that contribute to high p99 latencies and their implications on system performance. By sharing insights into best practices for latency reduction, we will demonstrate the value of optimizing low latency online feature stores for better performance.

Central to our discussion will be the significance of selecting the appropriate data model to meet application demands. We will cover various data model alternatives, highlighting their respective strengths and weaknesses.

Our goal is to empower practitioners to make informed decisions and ultimately achieve a well-tuned, efficient feature store capable of taming p99 latencies.

16 minutes
Register for access to all 60+ sessions available on demand.
Fill out the form to watch this session from the P99 CONF 2024 livestream. You’ll also get access to all available recordings.

Bhanu Renukuntla, Senior Software Engineer at Lyft

Bhanu Renukuntla is a Senior Software Engineer at Lyft Inc., where he is working on the ML Feature store. Before Lyft, Bhanu was an early employee at a San Francisco based startup where spent his time building the Data and ML platform. He earned his Master of Science degree in Electrical and Computer Engineering from UC San Diego and his B.Tech in Electrical Engineering from IIT Bombay.