Polaris

Polaris

@polarishub.io

ML-ready datasets and benchmarks for drug discovery. https://polarishub.io

763 followers0 following126 posts

View full thread

3/ Few highlights: — Many benchmarks reward models for finding what we already know — Drug discovery needs models that generalize, identify new biology, and flag problems early — Simple baselines still beat fancy models — We need clearer tasks, cleaner data, and shared frameworks

2/ Multiomics AI is moving fast, but the benchmarks aren’t keeping up with what drug discovery actually needs. The letter lays out the gap clearly and makes the case for why our community needs better, more realistic ways to measure progress.

1/ 🚀 Our updated paper on practically significant ML method comparison is now published in JCIM!🚀 How do we ensure a model that tops a leaderboard also delivers a practical, real-world impact in drug-discovery? This paper offers a clear framework to address the field's replicability crisis.

View full thread

3/ We're especially thrilled that this paper is open access thanks to the JCIM editor's choice program. We hope for the broad adoption of these guidelines to help close the gap between perceived progress and real-world impact in drug discovery.

1/ 🚀 Our updated paper on practically significant ML method comparison is now published in JCIM!🚀 How do we ensure a model that tops a leaderboard also delivers a practical, real-world impact in drug-discovery? This paper offers a clear framework to address the field's replicability crisis.

2/ The initial preprint was refined with invaluable feedback: ✅ Community: Unique open-feedback period hosted on Github: github.com/polaris-hub/.... ✅ Practical Learnings: Lessons learned from applying these guidelines in the ASAP Antiviral challenge. ✅ Peer Review: Formal review process at JCIM.

(1/3) 🎉 Exciting Updates: Antiviral Unblinded Datasets! 🎉 Following the release of the ASAP Discovery x OpenADMET antiviral challenge leaderboard, the evaluation code is now open-sourced and the unblinded datasets are available on Polaris. Unblinded Datasets: polarishub.io/datasets?acc...

(2/3) 📢 In addition, ASAP is hosting a virtual showcase tomorrow, April 30 at 11AM ET / 5PM BST featuring top performers from the challenge. Speakers will present their methods, background, and post-hoc analyses now that the test data is live. Register for the link: docs.google.com/forms/d/e/1F...

(3/3) Ready to explore the findings? Now’s your chance. Analyze the data, test your ideas, and drop your insights in the Discord. Join the Polaris community on Discord to dive deeper into the challenge results and share what you discover: discord.com/invite/cS6Nf...

We're thrilled to announce the formation of the new Multiomics Steering Committee! By "multiomics" we refer to the integration of high-dimensional data modalities at the cellular level, encompassing molecular (DNA, RNA, protein) and phenotypic (imaging-based, multi-cell-line viability) readouts. 🧵

View full thread

Led by experts from academia and industry, the committee includes: Oren Kraus (Recursion), Judith Mueller (Merck), Ali Denton (Valence Labs), Fabian J. Theis (Helmholtz Munich), Paula A. Marin Zapata (Bayer), Anne E. Carpenter (Broad Institute), Ian Barrett (AstraZeneca)... 🧵

and Rob Moccia (formerly Pfizer), Cuong Q. Nguyen (formerly GSK), Nate Robichaud (Nomic), William J. Godinez (Novartis), Tommaso Biancalani (Genentech), and Kristina Ulicna (Valence Labs). 🧵

We're thrilled to announce the formation of the new Multiomics Steering Committee! By "multiomics" we refer to the integration of high-dimensional data modalities at the cellular level, encompassing molecular (DNA, RNA, protein) and phenotypic (imaging-based, multi-cell-line viability) readouts. 🧵

Multiomics data holds the potential to unravel biological complexity by providing complementary insights into cellular states of disease and their modulation through novel therapeutics. We aim to propose clear definitions, identify benchmarking tasks, and encourage alignment on best practices. 🧵

We're thrilled to announce the formation of the new Multiomics Steering Committee! By "multiomics" we refer to the integration of high-dimensional data modalities at the cellular level, encompassing molecular (DNA, RNA, protein) and phenotypic (imaging-based, multi-cell-line viability) readouts. 🧵

View full thread

and Rob Moccia (formerly Pfizer), Cuong Q. Nguyen (formerly GSK), Nate Robichaud (Nomic), William J. Godinez (Novartis), Tommaso Biancalani (Genentech), and Kristina Ulicna (Valence Labs). 🧵

🚀 Antiviral Challenge Results! 🚀 After weeks of competition, and nearly 400 submissions, the antiviral challenge has concluded! Thank you to all of our participants. Each submission came with a report — check out the full leaderboard and find more details 👇

View full thread

🚀 Antiviral Challenge Results! 🚀 After weeks of competition, and nearly 400 submissions, the antiviral challenge has concluded! Thank you to all of our participants. Each submission came with a report — check out the full leaderboard and find more details 👇

📢 Antiviral Challenge Deadline Extended! 🦠 We’ve extended the deadline for the Antiviral Challenge until March 14th at 12:00 PM ET! 💡 To be eligible for the final leaderboard, you’ll need to share a short (~1 page) report about your method. Submit here: polarishub.io/competitions

Did you miss the cutoff for the last intermediate leaderboard of the antiviral challenge? We’re doing one last leaderboard update before the challenge ends on March 10th! Submit something by midnight, Feb 26th, to see how you place. Submit your results today: polarishub.io/competitions

Thanks to everyone who joined us last week! You can now watch the recording of the webinar: youtu.be/_ykP_tEVrOk

youtu.beHave protein-ligand co-folding methods moved beyond memorisation? | Peter ŠkrinjarYouTube video by PolarisHQ
Polaris@polarishub.io

We’re hosting @peterskrinjar.bsky.social for a webinar to discuss his latest paper “Have protein co-folding methods moved beyond memorization?”! Join live on Feb 21st at 11 AM ET. Register here: us06web.zoom.us/webinar/regi... Explore Runs N’ Poses on Polaris today: polarishub.io/benchmarks/p...

Reminder - this webinar is happening today at 11 AM ET! Join us live in ~40 minutes: us06web.zoom.us/webinar/regi...

us06web.zoom.usWelcome! You are invited to join a webinar: Have protein co-folding methods moved beyond memorization?. After registering, you will receive a confirmation email about joining the webinar.The Polaris team is excited to host first author Peter Škrinjar to discuss how training data similarity impacts protein-ligand binding. In the Runs N' Poses benchmark, the paper shows that current co-...
Polaris@polarishub.io

We’re hosting @peterskrinjar.bsky.social for a webinar to discuss his latest paper “Have protein co-folding methods moved beyond memorization?”! Join live on Feb 21st at 11 AM ET. Register here: us06web.zoom.us/webinar/regi... Explore Runs N’ Poses on Polaris today: polarishub.io/benchmarks/p...

We’re extremely excited to host Runs N’ Poses on Polaris! The authors show how current co-folding methods struggle to generalize beyond ligand poses in their training data. Explore the benchmark: polarishub.io/benchmarks/p... Explore the dataset: polarishub.io/datasets/pli...

Peter Škrinjar@peterskrinjar.bsky.social

Excited to share our latest preprint evaluating AlphaFold3, Boltz-1, Chai-1 and Protenix for predicting protein-ligand interactions, featuring our newly introduced benchmark dataset 🌹Runs N’ Poses🌹! www.biorxiv.org/content/10.1... 🧵👇 (1/n)

Polaris reposted

🚨 Extension Alert: The intermediate leaderboard submission deadline for the antiviral challenge has been extended to midnight on February 7th! Don't miss this chance to see how you stack up against other participants! Submit your results today: polarishub.io/competitions

You’ve heard us talk about our mission to be the source of truth for the ML community in drug discovery. But what does that really mean, and how does it shape the way Polaris is built? In the latest blog, we break down the key design choices that make this possible: polarishub.io/blog/reprodu...

View full thread

You’ve heard us talk about our mission to be the source of truth for the ML community in drug discovery. But what does that really mean, and how does it shape the way Polaris is built? In the latest blog, we break down the key design choices that make this possible: polarishub.io/blog/reprodu...

💻 ML-ready datasets — download what you need from Polaris and start training. No pre-processing and no wrangling with different file formats. It only takes a few lines of code to download what you need from Polaris!

Polaris reposted

Easy to get started on the antiviral challenge! I plan to submit some GP baselines from my PhD work (possibly with a collaborator).

Polaris@polarishub.io

It only takes a few lines of code to get started with the @asapdiscovery.bsky.social x @omsf.io antiviral challenge! In this short tutorial, we’ll show you how easy it is to login, load the challenge data, train a simple baseline model, and submit your predictions 🧵 youtu.be/KBZJFA_arAg

Polaris reposted

While we gear up to welcome both Polaris and ASAP to our Symposium in April, they have been cooking up something special. They're releasing an intermediate leaderboard for the antiviral challenge on the 31st. So you (looking at #CACHEChallenge participants!) have a few days to get in a prediction!

Polaris@polarishub.io

📣 We heard your feedback! We’ll be putting all results submitted by Jan 31st on an intermediate leaderboard so you can see how you rank across other participants in the antiviral challenge. Ready to put your predictions to the test? 📨 Submit your results today: polarishub.io/competitions

Who to expect: Ed Griffen (Lead Medicinal Chemist), Haim Barr (Lead Biochemistry), Jess Stacey (Sr. Comp Chem), Hugo MacDermott-Opeskin (Tech Lead) @jenkescheen.bsky.social, David Cousins (Sr Med Chem), Daren Fearon (Sr Scientist - Structural Biology). RSVP at the link above!

View full thread

But decoding molecular structures from mass spectra is incredibly challenging, even for human experts. That’s why researchers are increasingly turning to machine learning to tackle this problem. ML aims to make structure elucidation from mass spec data faster, more accurate, and more scalable

Mass spec plays a key role in identifying and characterizing molecules, particularly in biological and environmental samples. This is vital for advancing biomedical and chemical sciences—especially since ~half of today’s pill-based medicines were first discovered in nature.

For example, Rapamycin: a potent immunosuppressant, was first discovered in soil samples from Easter Island. Mass spec was used to reveal its structure, sparking a billion-dollar drug industry. It’s used to prevent organ transplant rejection, in cancer therapies, and has anti-aging potential.