Streaming Audio: A Confluent podcast about Apache Kafka

Load-Balanced Apache Kafka: Derivco’s Globally Distributed Gaming Business

May 02, 2019 Season 1 Episode 30

Confluent, original creators of Apache Kafka®

Normally, an Apache Kafka® application lives close to its cluster, in the same datacenter or availability zone. It expects small latencies, and allows the Kafka client libraries to perform connection pool management and load balancing to the cluster through the regular Kafka partition management mechanisms.



Life was not so simple for global gaming platform Derivco, who had to maintain central data infrastructure and application clusters in geographically diverse locations due to the heavily regulated nature of their business. In this episode, we talk about the challenges associated with that unusual but ingenious network architecture, along with other lessons they learned as they built their Kafka-centric gaming platform.