Post

We improved jupyterhub-home-nfs so that admins can see per-user home directory usage within minutes and get quota limits as metrics, so it’s easier to spot disk usage problems early. 2i2c.org/blog/faster-...

2i2c.orgFaster reporting of user home directory sizes | 2i2cStorage quotas help users avoid running out of space unexpectedly and give administrators visibility into capacity planning. However, storage usage can change rapidly, and it’s important to have…

21/1/26, 2:01 pm1 repost3 likes

2i2c

@2i2c.org

21 Jan

The old approach relied on crawling files to estimate directory sizes. That’s expensive on shared storage, so metrics had to run slowly to avoid impacting users. Now jupyterhub-home-nfs exports per-user usage / limits as Prometheus metrics, using filesystem quota accounting so it's much faster!

github.comGitHub - 2i2c-org/jupyterhub-home-nfs: In-cluster NFS server for JupyterHub home directories with usage quota enforcementIn-cluster NFS server for JupyterHub home directories with usage quota enforcement - 2i2c-org/jupyterhub-home-nfs

2i2c

@2i2c.org

21 Jan

We also aligned metric names and namespace with prometheus-dirsize-exporter so the same JupyterHub Grafana dashboards can be used regardless of where the usage data comes from.

2i2c

@2i2c.org

21 Jan

We've rolled out this improvement to our member community hubs, and others can use these updates via the repositories relevant to this improvement: github.com/2i2c-org/jup... github.com/2i2c-org/pro... github.com/jupyterhub/g... Full write-up and links: 2i2c.org/blog/faster-...