Daniel Heck

Daniel Heck

@danielheck.bsky.social

Professor of Psychological Methods @Phillips-Universtät Marburg Mathematical psychology | Cognitive modeling | Psychometrics | Bayesian statistics Personal: www.dwheck.de Team: https://www.uni-marburg.de/de/fb04/team-heck

1.1K followers741 following105 posts

Daniel Heck reposted

Daniel Heck reposted

Daniel Heck reposted

At the end of the term I asked my college creative wriing students to submit anonymous thoughts on AI. No real surprises: Mood ranges from resignation to despair, capitulation from embittered erosion of standards to total, feelings of betrayal from deep to furious. 1/

One more week to apply for the postdoc position 🙂 uni-marburg.de/78NrWT

Daniel Heck@danielheck.bsky.social

Postdoc position @unimarburg.bsky.social in the project: "Bridging the Gap Between Verbal Psychological Theories & Formal Statistical Modeling with Large Language Models" (funded by @volkswagenstiftung.de) 📅Start: 01.10.2026 |⏳3 years 🔗 Job posting: uni-marburg.de/78NrWT Thanks for sharing!

Daniel Heck reposted

Wichtigste Änderung neben dem Nichts, was letztlich drinsteht: Die Übernahme der nicht genutzten Zeiten in die Postdoc-Phase entfällt. Wer also unter sechs Jahre Befristung vor Abschluss der Promotion hatte, bekommt sie danach nicht mehr. #IchBinHanna #WissZeitVG

Jan-Martin Wiarda@jmwiarda.bsky.social

EXKLUSIV im Wiarda-Blog: BMFTR legt seinen mit Spannung erwarteten WissZeitVG-Referentenentwurf vor Vieles ist drin aus dem alten Ampelpaket, doch es gibt eine Lücke, mit der die meisten gerechnet hatten. Die Details im Wiarda-Blog: www.jmwiarda.de/blog/2026/05...

New preprint together with @timangelike.bsky.social: Evaluating Large Language Models for Feature Extraction from Verbal Stimuli: A Simulation-Based Workflow We draw on generalizability theory and the ADEMP-template for simulation studies to assess the multiverse of prompt decisions. osf.io/xphm9

Tim Angelike@timangelike.bsky.social

In a new preprint with @danielheck.bsky.social, we adapted the ADEMP framework to provide a structured workflow for evaluating LLM feature extraction from verbal stimuli. Link: doi.org/10.31234/osf.... Figure 1 from the paper shows the proposed workflow:

Email: "anbei senden wir Ihnen Ihre Biographie für den Europäischen Gelehrtenkalender. Wir wären Ihnen dankbar, wenn Sie uns etwaige Korrekturen mitteilen könnten." Kleingedrucktes im PDF: "Eintragungspreis Euro 369,-. Durch Rücksendung dieser bestätigten Textvorlage kommt ein Vertrag zustande."😮

"What follows are the five horsemen of the significance apocalypse [...] To the truly free-spirited researcher, they are a coordinated assault on productivity, publishability, and the ancient scholarly right to discover one’s hypotheses only after the data have had a proper chance to speak." 😅

Robert Böhm@robertboehm.bsky.social

🚨NEW PREPRINT🚨 together with Jürgen Huber & Michael Kirchler: “Massaging Significance in the Age of Open Science: A Satirical Tutorial,” which is a public service for anyone unwilling to let inconvenient data get in the way of a compelling narrative. 😉 Link to preprint: osf.io/preprints/ps...

Great quote by Cronbach, Gleser & Nanda (1972): "The tidy theory of error laid down for psychology at the start of the century by Spearman and Brown has always seemed just a little too tidy to describe the perverse behavior of real data." 😅

I always had the vague feeling that Scientific Reports and Nature Communications are mainly APC business models. A paper estimated the total APC for gold/hybrid Open Access per journal 2015–2018: doi.org/10.1162/qss_... Surprise, surprise - there are 2 outliers at the top😐

This is mainly due to the large number of published articles: "Scientific Reports published 73,206 articles and Nature Communications 16,122 articles between 2015 and 2018"

Conclusion of the paper: "Instead of making scholarly publishing sustainable and accessible for all, high APCs and transformative agreements aim to preserve the status quo, where academic publishing is a highly profitable business for a few corporations."

Daniel Heck reposted

Does it make sense to preregister simulation studies? This question has sparked a lot of debate. ▶️We* work through the why, when, and how ▶️We discuss different phases of methodological research to clarify where preregistration might (or might not) add value 📝 Preprint: doi.org/10.31234/osf...

New preprint by @semihaktepe.bsky.social 🎉 We compare ANOVA/SDT/GLMM for binary judgments in 20 datasets of the truth effect. #lme4 Main conclusion: "GLMMs are a theoretically sound and practically robust method and thus superior for analyzing binary judgments in social and cognitive psychology.”

PsyArXivBot@psyarxivbot.bsky.social

Analyzing Binary Judgments: A Comparison of ANOVA, Signal Detection Theory, and Generalized Linear Mixed Models in the Context of the Illusory Truth Effect: https://osf.io/xn397

Daniel Heck reposted

The latest version of Sigmund, the #AI #research assistant, is able to fully control the #OpenSesame interface. This allows you to build #psychology experiments entirely through conversation. This is no AI slop, but real functionality with real benefits! Tutorial 👉 osdoc.cogsci.nl/4.1/tutorial...

New paper by @matzekloft.bsky.social in Psychometrika🎉 We developed a model for aggregating response intervals which are obtained if a participant judges that the word "most" covers the range [86% - 97%]. The model aggregates such intervals while considering people's proficiency & item difficulty.

Matthias Kloft@matzekloft.bsky.social

The final paper of my dissertation has just been published in Psychometrika (@pmetricsoc.bsky.social). Many thanks to @bsiepe.bsky.social and @danielheck.bsky.social, who co-authored it with me. www.cambridge.org/core/journal...

The method worked better than simple aggregation for validation words such as "fifty-fifty chance", "never" or "always" (indicated in the plot by the black intervals compared to the gray interval areas).

Daniel Heck reposted

There still seems to be a lot of confusion about significance testing in psych. No, p-values *don’t* become useless at large N. This flawed point also used to be framed as "too much power". But power isn't the problem – it's 1) unbalanced error rates and 2) the (lack of a) SESOI. 1/ >

This post is unavailable.

Daniel Heck reposted

Simulation studies have a conflict of interest problem. The same team: - develops a new method - designs a simulation study to evaluate it However, the new method has to show good performance to get published. We propose living synthetic benchmarks to address the issue (doi.org/10.48550/arX...).

Daniel Heck reposted

Konservative 🤝Rechtsextreme = politischer Selbstmord? In vielen EU-Ländern versuchen konservative Parteien durch Kooperationen, rechtsextreme Parteien zu „zähmen“. Die CDU-nahe Konrad-Adenauer-Stiftung hat untersucht, was das für Konsequenzen hat. Spoiler: Es funktioniert nicht. 1/6🧵

spiegel.deLaut CDU-naher Studie: Rechte Parteien durch Kooperation zu zähmen, funktioniert nichtDer Rechtsruck beschäftigt nicht nur Deutschland, in anderen EU-Ländern versuchen sich rechte Parteien in Regierungsverantwortung. Die Konrad-Adenauer-Stiftung hat untersucht, was das für Konservative...

Daniel Heck reposted

1/3 I think the premise is worth some attention: why is there a (frequently wrong) expectation that science is precise? I am often confused even by textbooks for university student audiences. Confused about how frequently findings and expert judgements are portrayed as certain and final.

Daniel Heck@danielheck.bsky.social

"Science is expected to be precise, and admissions of uncertainty (especially large levels) can be perceived as scientific failures, rather than natural limitations of knowledge of a topic." 😕 Broomell et al. (2025). Expert judgment and communication of uncertainty. doi.org/10.1007/978-...

"Science is expected to be precise, and admissions of uncertainty (especially large levels) can be perceived as scientific failures, rather than natural limitations of knowledge of a topic." 😕 Broomell et al. (2025). Expert judgment and communication of uncertainty. doi.org/10.1007/978-...

doi.orgExpert Judgment and Communication of UncertaintyKnowledge built through the scientific study of climate is essential for informed decision-making. In the presence of irreducible uncertainty, the results of climate science must be gathered and synth...