Post

After bumping into an old Reddit colleague and chatting about CDC, the next talk at #current26 is hearing from @datadoghq.com about how they run their multi-PB streaming architecture. 10^4 brokers hosting 10^6 partitions 🤯

19/5/26, 2:36 pm0 reposts1 like

Tom Cooper

@tomcooper.dev

19 May

This was my favourite #Current26 talk of the day, an interesting solution to a unique situation but some ideas that can apply to many other Kafka deployments. I am particularly interested in what we could do in upstream Kafka to make backfilling jobs less disruptive 🤔