Tom Cooper

I think I was just Rick-Rolled by GLM-5.3

ossip.devOSSIP - Open Source Software Improvement Proposals

My site for tracking OSS improvement proposals (ossip.dev) has had lots of updates recently, including adding tracking for strimzi.io, @kroxylicious.io and streamshub.io. It also has its own update feed on blusky: @oss-ip.bsky.social I also got a shout out in @rmoff.net's excellent newsletter!

27 Aug

First Dolly, then Tim and now Optimus www.bbc.co.uk/news/article... 'til all are one....

25 July

OMG! It came! Now listening: Transformers The Movie OST - The Reformatted Edition

storm.apache.orgApache Storm 3.0.0 ReleasedApache Storm is a free and open source distributed realtime computation system. Storm makes it easy to reliably process unbounded streams of data, doing for realtime processing what Hadoop did for bat...

23 July

Congratulations to Apache Storm on their 3.0.0 release: storm.apache.org/2026/07/22/s... I need to spend some time updating my knowledge of it, its been 6 years since I finished my PhD based on performance modelling of Storm Topologies tomcooper.dev/phd/

Tom Cooper reposted

Kafka Streams

@kafkastreams.bsky.social

25 June

Apache Kafka 4.3.1 was released. It contains a critical memory-leak bug fix for #KafkaStreams. Thanks to our RM Bill Bejeck for the quick turnaround on this downloads.apache.org/kafka/4.3.1/...

downloads.apache.orgdownloads.apache.orgBelow is a summary of the JIRA issues addressed in the 4.3.1 release of Kafka. For full documentation of the release, a guide to get started, and information about the project, see the Kafka project site.

theguardian.comStarmer says he ‘will stand’ in any Labour leadership contest after Burnham’s decisive byelection win – UK politics liveBurnham hails a ‘turning point’ for the country after a resounding victory over Reform UK and Restore

Hummmm 🤔 www.theguardian.com/politics/liv...

Tom Cooper reposted

James O’Brien

@mrjamesob.bsky.social

Memo to pretty much (but obviously not quite) everybody in the media…

George Eaton@georgeeaton.bsky.social

Reform have now lost six by-elections in a row in England, Scotland and Wales. Their national poll rating is 26% – below Labour in 1983 – and Farage’s approval rating is -37. They’re very far from the voice of the people and need to stop being treated as such.

Burnham probably got most of the Lib Dem, Green and disaffected Tory votes. But damn... is it nice to see the Labor vote far ahead of the combined right-wing vote. Tactical voting FTW.

Britain Elects@britainelects.com

✅ BURNHAM IN Makerfield by-election result: LAB: 54.8% (+9.6) REF: 34.5% (+2.7) RST: 6.8% (+6.8) CON: 2.2% (-8.7) GRN: 0.7% (-3.7) LDEM: 0.4% (-6.4)

Is that hope I feel.... www.theguardian.com/politics/202...

secure.hopenothate.org.ukRussia set Britain on fire. Demand an inquiry.The men who tried to set fire to Kier Starmer’s house were taking orders from Russia. Our research shows this was not an isolated plot. It was part of a wider Russian operation on British soil. Add yo...

15 June

We need to get to the bottom of Russian interference in our country and crucially hold those who work with them responsible. Please consider signing this petition from @hopenothate.org.uk to demand a wide reaching inquiry secure.hopenothate.org.uk/page/193695/...

reddit.comFrom the RedditEng community on RedditExplore this post and more from the RedditEng community

3 June

Next up at #StrimziCon2026 is Sky Kistler from Reddit talking about how they migrated there massive AWS EC2 based Kafka infra to a Strimzi based solution running on Kubernetes: www.reddit.com/r/RedditEng/...

3 June

I used to be part of Sky's team and played a part in the early planning of this migration. I am very proud to see what the team has achieved!

community2.cncf.ioStrimziCon 2026 | CNCFVirtual Event - StrimziCon is an event for developers, DevOps engineers, and solution architects who want to learn about Strimzi and event streaming. Strimzi is an operator for running Apache Kafka on...

3 June

#StrimziCon2026 just kicked off, join us to hear from maintainers and users of Strimzi about how to use Strimzi to full effect and what is coming in the future! community2.cncf.io/events/detai...

Last breakout session of #Current26 is sticking with my Kafka Streams theme, a walkthrough of designing a production grade application based on Kafka Streams

Now attending the World Premiere conference talk on Hardwood: the new Apache Parquet parser by @gunnarmorling.dev at #Current26

A really fascinating talk on the internal details of Parquet. Gunnar is now finishing with some guidance on using AI tools for creating low level infrastructure code

Another Kafka Streams talk at #Current26, this time from Michelin around KS automatic resource naming and all the "fun" that comes from that

Continuing the rebalancing theme at #Current26, with a talk on the challenges of large rebalances in Kafka Streams and moving to KIP-1071 based rebalances

Not sure I said "rebalance" enough there...anyway KIP-1071 is a beautiful thing

This was a really interesting talk with some great tips on using the new streams protocol and crucially some actual experimental results showing the clear improvement 👏👏👏

Next up at #Current26, time to get into some Kafka internals and learn about broker-side partition assigners (post KIP-848)

I wonder if we could make a service like Cruise Control but for Kafka Consumers and have a custom partition assigner that calls out to that for rebalancing decisions 🤔

Buuuuuuut as the speaker highlights, assignment needs to be fast and shouldn't block 😔

Kicking off #Current26 Day 2 with a talk from LinkedIn on dealing with trillion event CDC systems. Leaning about this Brooklin things I have been hearing about for years.

Finishing the first day of #Current26 in style with the Strimzi AMA

Discussing what's next for Strimzi after 1.0: Cert Manager support, Cruise Control self-healing support and Kubernetes Gateway API support as the replacement for NGINX Ingress Controller...

After bumping into an old Reddit colleague and chatting about CDC, the next talk at #current26 is hearing from @datadoghq.com about how they run their multi-PB streaming architecture. 10^4 brokers hosting 10^6 partitions 🤯

This was my favourite #Current26 talk of the day, an interesting solution to a unique situation but some ideas that can apply to many other Kafka deployments. I am particularly interested in what we could do in upstream Kafka to make backfilling jobs less disruptive 🤔

Next up at #Current26: Writing Supersonic Kafka apps using @quarkus.io

The demo gods have struck at #Current26 and sadly we can participate in the online quarkus race game but there is a backup script to simulate audience participation 😅

Next up at #current26 is a talk on keeping data private in your streaming pipelines, apparently Gremlins are involved.... I wonder if a particular gremlin blocking Crocodile (@kroxylicious.io) could help here too 🤔

@michaeldrogalis.bsky.social's ShadowTraffic gets a shout out for generating test data for developing streaming privacy tools.

kroxylicious.ioUse CasesNetwork proxy framework for Apache Kafka

I reckon most, if not all of these privacy tools could be implemented with @kroxylicious.io filters

This #Current26 talk uses very Confluent specific tooling (unsurprisingly) but if you want encryption at rest you can use the OSS @kroxylicious.io Kafka proxy kroxylicious.io/use-cases/#e... Kroxy has a pluggable architecture so record masking and other privacy features can be added in easily

I'm having a @kafkastreams.bsky.social theme at #Current26, so I'm kicking things off with a talk about record headers in Kafka Streams state stores

Great to catch up with @gunnarmorling.dev and @rmoff.net at #Current26, looking forward to Gunnar's talk tomorrow about the new Parquet parser he has created and what that might mean for Flink (and maybe Kafka Streams)!

I have to compliment the audio setup at #Current26, the J-Arrays have some serious bass. The intro music lost me several Hz of my lower range....

Kicking off #Current2026 with a thank you to the community that makes all this possible!

youtu.beKroxylicious IntroductionYouTube video by Kroxylicious

Turns out the hashtag is actually #Current26, hopefully there is a streaming join out there merging all these posts....

Tom Cooper reposted

kroxylicious.io

@kroxylicious.io

9 Mar

Kroxylicious is the snappy open source proxy for Apache Kafka®. See how it works in 3 minutes: youtu.be/xLOjKScpJ3Q #ApacheKafka #Kroxylicious #EventStreaming #DataEngineering

Tom Cooper reposted

Ian Coldwater 🧊🚫

@lookitup.baby

15 Sept 2025

Today is the 30th anniversary of Hackers

youtu.bePhased upgrades of Strimzi managed Kafka fleetsYouTube video by Strimzi

7 July 2025

A bit late, but the recording of my #StrimziCon2025 talk, Phased Upgrades of Strimzi Managed Kafka Fleets (hows that for a snappy title) is now up on Youtube: youtu.be/pEuYFFkQCUU?...

30 June 2025

It's my last day at Red Hat. Tomorrow I & the rest of middleware move to IBM. I wanted to work at RH since I heard about Fedora on the Linux Action Show (RIP) decades ago & I've loved developing in the open with RH. That'll continue after the move & after all, no one got fired for buying IBM...

Tom Cooper reposted

Gunnar Morling

@gunnarmorling.dev

14 June 2025

🐊 Kroxylicious Proposal: "Routing API" This looks like a very useful addition to @kroxylicious.io (wire-protocol proxy for Apache Kafka): dynamic routing of requests to different upstream clusters, enabling use cases such as union clusters and client-based routing. 👉 github.com/kroxylicious...

strimzi.ioTaming the Kafka Chaos: How Strimzi Helped Us Scale with ConfidenceStrimzi provides a way to run an Apache Kafka cluster on Kubernetes in various deployment configurations.

9 June 2025

Going from 1 to 13 PB/day 🤯 thanks to moving from a self-managed to a Strimzi-managed Kafka cluster! Great to hear these stories of how Strimzi not only made life easier for infra teams but improved the service they provide! strimzi.io/blog/2025/06...

21 May 2025

Ending #Current25 with a talk on Polymorphic Table Functions in Flink🤘

21 May 2025

"Process" not "Polymorphic" 🤦‍♂️