Post

I'm catching up on the observability discussion and it seems data gravity strikes again. Matt Klein, of Envoy proxy fame, makes his case for federating observability control planes across devices to cut costs and provide deeper analysis than can be achieved by sending logs to a centralized service.

I'm not sure the approach warrants a version bump, but it does feel like a natural evolution of the observability practice, which aligns with working with any large set of data. Sometimes you gotta move compute to where the data is, and given how powerful even mobile devices are, it might just work.

Given how high people's observability bills are, I gotta feeling the practice of analyzing logs and metrics locally is going to take off. A federated control plane could provide a "single pane of glass" while edge devices do the heavy lifting.

1 repost19 likes

Our solution is based on Federated control planes and it's starting resonate with customers. Apart from the obvious cost savings there are other advantages. A smart agent is able to process the data locally and identify issues faster.

I believe Matt's focus is on mobile devices but his approach to observability reminds me of what Pixie Labs, acquired by @newrelic.bsky.social, was doing for Kubernetes metrics, where processing took place inside the cluster, and allowed a hosted control plane access for visualizations and alerts.