Is It Faster to Go with Redpanda Transactions than Without Them?!

We all know that distributed transactions are expensive, have higher latency and lower throughput compared to a non-transactional workload. It’s just common sense that when we ask a system to maintain transactional guarantees it should spend more time on coordination and thus have poorer performance, right? Well, it’s true that we can’t get rid of this overhead. But at the same time each transaction defines a unit of work, so the system stops dealing with individual requests and becomes more aware about the whole workload. Basically it gets more information and may use it for new kinds of optimizations which compensate for the overhead. In this talk I’ll describe how Redpanda optimized the Kafka API and pushed throughput of distributed transactions up to eight times beyond an equivalent non-transactional workload while preserving sane latency.

14 Minutes
Denis Rystsov

Denis Rystsov, Staff Engineer at Vectorized

Denis Rystsov is a staff engineer at Vectorized working on Redpanda, a Kafka-compatible distributed event streaming platform. His area of expertise lies in distributed transactions, consensus algorithms, and testing consistency models. He likes to keep an eye on academic computer science research and use it as leverage in the industry. Denis volunteers as a member of the Hydra conference program committee and as a member of the editorial board of the Journal of Systems Research (JSys). He received his MSc in Applied Mathematics and Computer Science from SPbSU. Before joining Vectorized he worked at Yandex, Amazon, and Microsoft. Apart from work he likes surfing and exploring the waters of the PNW.

Register for 2 days of keynotes & interactive tech talks on all things P99.

Virtual Event

October 19-20, 2022

Share on social with #p99conf and a link to for a chance to win $500.