Giacomo Bignardi

Giacomo Bignardi

@bignardi.bsky.social

Research Associate at the Social, Genetic & Developmental Psychiatry Centre, Kings College London. Interests: developmental psychology, data science, coffee. www.bignardi.co.uk

582 followers1.1K following109 posts

Giacomo Bignardi reposted

Giacomo Bignardi reposted

1/ I am thrilled to begin sharing the latest release of pyEM, a Python package I built for fitting cognitive computational models to behavioral data using hierarchical expectation maximization (EM) with maximum a posteriori estimation (MAP). github.com/shawnrhoads/...

Giacomo Bignardi reposted

Interested in exploring the intergenerational consequences of #racism? On 9 June 2026, ACAMH’s #ACEs SIG will hold a brilliant webinar on this very topic. In this Q&A, we caught up with the presenter – Dr. Yasmin Ahmadzadeh – about her research, and her hopes for the event. https://bit.ly/3PgufW2

bit.lyMeet the expert: Intergenerational consequences of racism, with Dr. Yasmin AhmadzadehOn 9 June 2026, ACAMH’s Adverse Childhood Experiences (ACEs) Special Interest Group will hold its next meeting, Intergenerational Consequences of Racism. We caught up with the presenter - Dr. Yasmin A...

Giacomo Bignardi reposted

Replying to @pwgtennant.bsky.social

Scientists should be judged not just on their research, but the claims they make. Quitting smoking is one of the most powerful ways you can improve your health. Visiting a museum can never come close. Such a claim should require extraordinary evidence. This study is anything but. 18/18 🧵

Giacomo Bignardi reposted

BGA needs people to communicate if their not going to back out/cancel last minute, or will only be present on 1/2 days, so they can allocate spots to our colleagues and friends who otherwise currently cannot attend due to venue capacity.

Behavior Genetics Association@behaviorgenetic.bsky.social

⚠️ This BGA has turned out to be exceptionally popular with unprecedented numbers of submissions and people wanting to attend. We are now holding a waiting list for non-speakers (this includes symposia Chairs and Discussants) who have not yet registered.

Giacomo Bignardi reposted

🚨 Call for Abstracts: The New Measurement Heretics We welcome proposals from researchers in the philosophy, history, sociology, and anthropology of measurement who would like to address themes around formal & informal measurement concepts ⚖️ Find out more 👇 medhumsplatform.org/call-for-abs...

medhumsplatform.orgCall for Abstracts: The New Measurement HereticsWe invite proposals from researchers in the philosophy, history, sociology and anthropology of measurement for a new edited collection. Deadline 15 June 2026.

Giacomo Bignardi reposted

I've made an R package for Bayesian Rasch #psychometrics with brms models, easyRaschBayes (on CRAN), implementing simple functions to create figures and tables with model fit metrics, etc. Attaching figures from conditional item infit, item-restscore with GK gamma, and the log-likelihood criterion.

Giacomo Bignardi reposted

"There are signs that the Bayes Factor is increasingly taking on a role analogous to that of the p-value, serving as a device for the automation of decisions rather than as a tool for substantive inference." Excellent new preprint by Carol Ting on the rise of NHST. #Methodology #stats

arxiv.orgThe Rise of Null Hypothesis Significance Testing (NHST): Institutional Massification and the Emergence of a Procedural EpistemologyIt has long been a puzzle why, despite sustained reform efforts, many applied scientific fields remain dominated by Null Hypothesis Significance Testing (NHST), a framework that dichotomizes study res...

Giacomo Bignardi reposted

as I'm revising my course materials, I keep stumbling upon cool @mc-stan.org developments. Current favorites: 1. your model has funnels and you exhausted reparametrization ideas: metric = "dense_e" makes your HMC learn about covariance btw parameters. Sloooow, but effective! 1/

Hot take: one of the main benefits of running data analyses in 🐬 Docker 🐬 isn't reproducibility, but saving yourself (or your lab) hundreds or thousands of pounds in computer costs*. Here's how... #datascience #docker #rstudio #python *for a very niche set of people

View full thread

But you can also buy a windows/linux desktop or mini PC with lots of RAM for far less money, if you don't mind slightly worse CPU performance. The differences are even bigger if you need 128GB of RAM....

Hot take: one of the main benefits of running data analyses in 🐬 Docker 🐬 isn't reproducibility, but saving yourself (or your lab) hundreds or thousands of pounds in computer costs*. Here's how... #datascience #docker #rstudio #python *for a very niche set of people

View full thread

If you already have a gaming computer at home, with Docker + Tailscale, you can work from it remotely pretty seamlessly. Alternatively, if you only occasionally need more computer power, you can rent a server (running Docker) from your university or a private company (e.g., www.hetzner.com/cloud).

hetzner.comFlexible Cloud Hosting Services und VPS ServerHetzner Cloud Hosting Services ✓ VPS Server und Block Storage ✓ günstige Preise ✓ in Deutschland, Finland, USA und Singapur

Apple users who need 64GB of RAM will need to shell out either £3,879 for a MacBook 16 Pro or £1,839 for a Mac mini. Therefore, you could get both a 64GB mini and a basic MacBook Air (£900) for much less - and you'll only lose £900 when you leave your laptop on the tube.

Hot take: one of the main benefits of running data analyses in 🐬 Docker 🐬 isn't reproducibility, but saving yourself (or your lab) hundreds or thousands of pounds in computer costs*. Here's how... #datascience #docker #rstudio #python *for a very niche set of people

View full thread

A nice thing about Docker (though this isn't exclusive to Docker) is that it runs RStudio Server, which we access via a web browser. By default, we can only access it on our own computer, but we can also access it from other computers via a secure, encrypted connection using the free app Tailscale.

For illustrative purposes, I've installed tailscale on my desktop and phone. On my phone, I simply replace the localhost part of the web address with the tailscale ip address of my desktop, and bingo, I can access RStudio server on another device - and it works largely the same.

Hot take: one of the main benefits of running data analyses in 🐬 Docker 🐬 isn't reproducibility, but saving yourself (or your lab) hundreds or thousands of pounds in computer costs*. Here's how... #datascience #docker #rstudio #python *for a very niche set of people

Most of us work partly from home, so we need to work in different locations. For most, this means buying a laptop. However, if you work with large datasets and do complex analyses, you may need a higher-spec laptop with more RAM, which can cost 2-3x as much as the basic-spec version.

...claims such as: "Gen Z is the first population to cognitively underperform us on every measure", "Once countries widely adopt digital technologies in school, performance goes down wildly.", "We have evolved biologically to learn from other human beings, not from screens."

Giacomo Bignardi reposted

Giacomo Bignardi reposted

In 2021 we reported that live learning outperformed recorded learning. In a new preregistered analysis, my first senior-author paper led by Stan de Visser (pre-print), we find that this benefit does not increase with interactivity. The potential to interact may be enough to boost learning. A thread:

Giacomo Bignardi reposted

This is really neat. I have borrowed the reliability() function to my `easyRasch` package, and use plausible values instead of fully Bayesian estimation to produce similar estimates/CIs, see code example below. RMU point estimates are similar to EAP reliability. pgmj.github.io/easyRasch/re...

Giacomo Bignardi@bignardi.bsky.social

New preprint with @rogierk.bsky.social @paulbuerkner.com - we introduce "relative measurement uncertainty" - a reliability estimation method that's applicable across a broad class of Bayesian measurement models (e.g., generative-, computational- and item response theory-models osf.io/h54k8

I've added a new example to our paper's repo, demonstrating how our reliability method replicates Cronbach's alpha for a simple model, but also how our method can account for: (i) binary data, (ii) varying numbers of items per pps, & (iii) improvement over trials www.bignardi.co.uk/8_bayes_reli...

bignardi.co.ukEstimating Mean Score Reliability with RMU
Giacomo Bignardi@bignardi.bsky.social

New preprint with @rogierk.bsky.social @paulbuerkner.com - we introduce "relative measurement uncertainty" - a reliability estimation method that's applicable across a broad class of Bayesian measurement models (e.g., generative-, computational- and item response theory-models osf.io/h54k8

View full thread
View full thread

In the paper, we also demonstrate that our method yields a similar point estimate to using the ratio of subjects' posterior mean variance (PMV) divided by PMV + average posterior variance. However, our approach also provides credible intervals, which are essential when sample sizes are small.

View full thread

We ran 3 simulation studies to evaluate RMU's bias, accuracy and coverage (% of times the 95% credible intervals included the right answer) across linear factor, signal detection theory and reinforcement learning models. Results were good-to-great across studies and simulation conditions.

We also compared RMU to coefficient alpha and H (Study 1) and split-half reliability (Study 2). RMU generally had lower bias and error, as well as better coverage. However, the main benefit of RMU is that it can be applied across a wide range of Bayesian measurement models - unlike alpha.

View full thread

The intuition behind our method is that the amount of overlap between posteriors is important: in the example above, if the posteriors became significantly broader, we would be much more uncertain in each estimate and struggle to distinguish between participants, reducing reliability.

Our method involves taking two random draws (without replacement) from each subject's posterior and computes the correlation between draws. We repeat this process many times and use the distribution of correlations to calculate credible intervals or posterior probabilities (e.g., reliability > .70).

While estimating reliability with questionnaires is straightforward, there are few methods when deriving individual differences from computational models. Thus, reliability is often poor for widely used computational measures when evaluated with retest data (e.g., pubmed.ncbi.nlm.nih.gov/36940888/ )

pubmed.ncbi.nlm.nih.govIndividual differences in computational psychiatry: A review of current challenges - PubMedBringing precision to the understanding and treatment of mental disorders requires instruments for studying clinically relevant individual differences. One promising approach is the development of com...

Our reliability method can be applied to most fitted Bayesian measurement models. In the example below, I've used a Bayesian signal detection model to estimate posterior distributions for each subject's performance on a go/no-go test. Each curve shows our certainty in each subject's estimate.