Viacheslav Borovitskiy

Viacheslav Borovitskiy

@vabor112.bsky.social

Assistant Professor in Machine Learning @ University of Edinburgh. PhD in Mathematics. Ex ETH Zurich. See https://vab.im/vacancies/

142 followers68 following32 posts

Deadlines: 🔹 ELLIS PhD Program: 31 Oct 🔹 School of Informatics scholarships (fully funded; home & international): 30 Nov 🔹 CDTs: Nov–Jan Home-fee applicants especially encouraged: more funding available. Email me before applying, and please help spread the word! 2/2

🔹 Convexity? Message passing GNNs find different weights but learn remarkably similar functions—even where they fail. We hypothesize the architecture induces function-space convexity, making them behave like linear models despite their depth. Formalizing this is an open problem.

Since Bayesian GCNs did much better, standard ensembling seemed to be the culprit. Pedro dug in to see if this was an isolated anomaly or a general phenomenon pertaining to message passing GNNs (like GCNs and GATs). Here is what we found: 👇

🔹 Epistemic collapse: Deep ensembles rely on model disagreement to improve uncertainty (no diversity = no improvement). Across 6 highly diverse datasets, a severe lack of diversity is exactly what we observed. This is a stark contrast to foundational computer vision papers.

My first paper with my first PhD student @pedrocvieira.bsky.social just landed on arXiv! 🎉 “Do Deep Ensembles Actually Capture Uncertainty in Graph Neural Networks?” Spoiler alert: the answer is largely no—at least, not much more than a single model does. 🧵👇 📄 arxiv.org/abs/2605.22593

arxiv.orgDo Deep Ensembles Actually Capture Uncertainty in Graph Neural Networks?While deep ensembles are widely considered to be the default method for uncertainty quantification in deep learning, their effectiveness for graph-structured data is often simply assumed based on succ...

The origin story: This started from a tutorial benchmark (see image). I was surprised to find deep ensembles of GCNs failing miserably there. Point predictions were fine, but they yielded wildly overconfident uncertainty maps and an NLL much worse than a trivial N(µ, σ²) baseline!

View full thread
View full thread

✅ Spaces: Graphs, Meshes, Hyperspheres, Tori, Hyperbolic spaces, SPD matrices, & Lie Groups (SO(n), SU(n)). ✅ Infrastructure: Run seamlessly on PyTorch, JAX, TensorFlow, or NumPy. ✅ Integrations: Plug-and-play wrappers for GPyTorch & GPJax.

Why care about kernels in 2026? To build probabilistic models on geometric domains! Kernels drive Gaussian processes. While they famously struggle in high dim-s (images/text), many geometric domains are intrinsically low-dim, making these models shine (road networks/3D surfaces).

I am hiring a fully-funded #PhD in #ML to work at the University of Edinburgh on 𝐠𝐞𝐨𝐦𝐞𝐭𝐫𝐢𝐜 𝐥𝐞𝐚𝐫𝐧𝐢𝐧𝐠 and 𝐮𝐧𝐜𝐞𝐫𝐭𝐚𝐢𝐧𝐭𝐲 𝐪𝐮𝐚𝐧𝐭𝐢𝐟𝐢𝐜𝐚𝐭𝐢𝐨𝐧. Application deadline: 31 Dec '25. Starts May/Sep '26. Details in the reply. Pls RT and share with anyone interested!

Presenting today at #ICLR2025! Poster session 1, 10:00-12:30, #427. Oral Session 2F 16:18-16:30. iclr.cc/virtual/2025...

Kacper Wyrwal@wyrwalkacper.bsky.social

Excited to share our ICLR 2025 oral "Residual Deep Gaussian Processes on Manifolds"! With @vabor112.bsky.social & @arkrause.bsky.social, we introduce manifold-to-manifold GPs that can be composed together, generalising deep GPs to manifolds. Applications include wind prediction & Bayes opt! 1/n

Amazingly, Kacper did the bulk of the work for this ICLR oral as his undergrad thesis 💪

Kacper Wyrwal@wyrwalkacper.bsky.social

Excited to share our ICLR 2025 oral "Residual Deep Gaussian Processes on Manifolds"! With @vabor112.bsky.social & @arkrause.bsky.social, we introduce manifold-to-manifold GPs that can be composed together, generalising deep GPs to manifolds. Applications include wind prediction & Bayes opt! 1/n

Viacheslav Borovitskiy reposted

🚀 𝐏𝐡𝐃 𝐎𝐩𝐩𝐨𝐫𝐭𝐮𝐧𝐢𝐭𝐲 𝐚𝐭 𝐈𝐦𝐩𝐞𝐫𝐢𝐚𝐥 Looking for my first PhD student 🔬 Project: 𝐈𝐦𝐩𝐚𝐜𝐭 𝐨𝐟 𝐞𝐧𝐯𝐢𝐫𝐨𝐧𝐦𝐞𝐧𝐭𝐚𝐥, 𝐯𝐢𝐫𝐚𝐥, 𝐛𝐞𝐡𝐚𝐯𝐢𝐨𝐮𝐫𝐚𝐥 & 𝐩𝐬𝐲𝐜𝐡𝐨-𝐬𝐨𝐜𝐢𝐚𝐥 𝐞𝐱𝐩𝐨𝐬𝐮𝐫𝐞𝐬 𝐨𝐧 𝐡𝐞𝐚𝐥𝐭𝐡 Joint with LSHTM & UKHSA See links below. 📅 𝐃𝐞𝐚𝐝𝐥𝐢𝐧𝐞: 7 March 2024 📩 Questions? DM me! #PhD #HealthEquity #ImperialCollege

View full thread

Crucially, the resulting kernels support 𝒂𝒖𝒕𝒐𝒎𝒂𝒕𝒊𝒄 𝒓𝒆𝒍𝒆𝒗𝒂𝒏𝒄𝒆 𝒅𝒆𝒕𝒆𝒓𝒎𝒊𝒏𝒂𝒕𝒊𝒐𝒏 of the relative importance of the three Hodge decomposition parts.

View full thread

Crucially, the resulting kernels support 𝒂𝒖𝒕𝒐𝒎𝒂𝒕𝒊𝒄 𝒓𝒆𝒍𝒆𝒗𝒂𝒏𝒄𝒆 𝒅𝒆𝒕𝒆𝒓𝒎𝒊𝒏𝒂𝒕𝒊𝒐𝒏 of the relative importance of the three Hodge decomposition parts.

This makes them perform well on tasks ranging from modeling 𝒂𝒓𝒃𝒊𝒕𝒓𝒂𝒈𝒆-𝒇𝒓𝒆𝒆 𝒎𝒂𝒓𝒌𝒆𝒕𝒔 to 𝒑𝒊𝒑𝒆 𝒏𝒆𝒕𝒘𝒐𝒓𝒌𝒔 or 𝒐𝒄𝒆𝒂𝒏 𝒄𝒖𝒓𝒓𝒆𝒏𝒕𝒔 (arxiv.org/abs/2310.19450).

arxiv.orgHodge-Compositional Edge Gaussian ProcessesWe propose principled Gaussian processes (GPs) for modeling functions defined over the edge set of a simplicial 2-complex, a structure similar to a graph in which edges may form triangular faces. This...
View full thread

This leads to the 𝑯𝒐𝒅𝒈𝒆 𝑫𝒆𝒄𝒐𝒎𝒑𝒐𝒔𝒊𝒕𝒊𝒐𝒏 which splits any edge flow into three parts: pure divergence (curl-free), pure curl (div-free), and harmonic (curl-free & div-free). This allows three different Matérn kernels , one for each part.

On top of these, you can define a 𝑯𝒐𝒅𝒈𝒆-𝒄𝒐𝒎𝒑𝒐𝒔𝒊𝒕𝒊𝒐𝒏𝒂𝒍 𝑴𝒂𝒕𝒆́𝒓𝒏 𝒌𝒆𝒓𝒏𝒆𝒍, which is a linear combination of the pure div, pure curl, and harmonic Matérn kernels, each possible with a different set of hyperparameters.

View full thread

However, a simplicial 2-complex offers much more. Its structure allows characterizing key properties of edge flows using the discrete concepts of divergence (𝒅𝒊𝒗) and 𝒄𝒖𝒓𝒍, measuring how edge flows diverge at nodes and circulate along faces.

First, a bit about theory. Mathematically, the kernels are defined on the edge set of a 𝒔𝒊𝒎𝒑𝒍𝒊𝒄𝒊𝒂𝒍 2-𝒄𝒐𝒎𝒑𝒍𝒆𝒙, i.e. a graph along with a set of triangular faces formed by some of its edges.

Check out the workshop "Uncertainty in multivariate, non-Euclidean, and functional spaces: theory and practice" Where: Isaac Newton Institute, Cambridge When: 6-9 May 2025 Application deadline: 12 Jan 2025. Link in reply (contributed talks/posters are welcome) I will be there!

You are up to date.