Post

@drmorr.appliedcomputing.io

Heyyyy you guuuuiiiiiise I decided one Kubernetes simulator wasn't enough so last week I wrote another one. github.com/acrlabs/sk-s...

github.comGitHub - acrlabs/sk-spark: Discrete event simulator for Kubernetes spark jobsDiscrete event simulator for Kubernetes spark jobs - acrlabs/sk-spark

27/7/26, 9:29 pm1 repost4 likes

drmorr

@drmorr.appliedcomputing.io

27 July

sk-spark is part of the SimKube suite of tools; it's useful for simulating the behaviour of Spark on top of Kubernetes, together with Karpenter as a node autoscaler. The question it's designed to answer is "how does Karpenter's consolidation behaviour impact the success rate of Spark jobs?"

drmorr

@drmorr.appliedcomputing.io

27 July

Anyways, I had fun with this one! Take a look and play around with it if you want. It's in Rust, of course. Next week (probably) I will write a blog post to describe it in more detail.