Daniel Vila

Daniel Vila

@dvilasuero.hf.co

Everything datasets and human feedback for AI at Hugging Face. Prev: co-founder and CEO of Argilla (acquired by Hugging Face)

3.6K followers573 following56 posts

Daniel Vila reposted

💫 Generate RAG data with the Synthetic Data Generator to improve your RAG system! 1️⃣ Generate from your documents, dataset, or dataset description. 2️⃣ Configure it. 3️⃣ Generate the synthetic dataset. 4️⃣ Fine-tune the retrieval and reranking models. 5️⃣ Build a RAG pipeline.

Daniel Vila reposted

New chapter in the Hugging Face NLP course! 🤗 🚀 We've added a new chapter about the very basics of Argilla to the Hugging Face NLP course. Learn how to set up an Argilla instance, load & annotate datasets, and export them to the Hub.  Any feedback for improvements welcome!

Daniel Vila reposted

🎉 50,000+ annotations reached! The FineWeb2-C community is helping build better language models on annotation at a time. 📊 Current stats: - 115 languages represented - 419 amazing contributors - 24 languages with complete datasets But we're not done yet! 🧵

Daniel Vila reposted

Was 2024 the year of datasets? Is 2025 the year for community-built datasets? It's exciting to see the progress of many languages in FineWeb-C: - Total annotations submitted: 41,577 - Languages with annotations: 106 - Total contributors: 363

💥 Ending 2024: A full data annotation journey on the Hugging Face Hub—from raw data to training-ready datasets! With Argilla 2.6.0, push your data to the Hub from the UI Let’s make 2025 the year anyone can build more transparent and accountable AI—no coding or model skills needed.

Daniel Vila reposted

🚀 Argilla v2.6.0 is here! 🎉 Let me show you how EASY it is to export your annotated datasets from Argilla to the Hugging Face Hub. 🤩 Take a look to this quick demo 👇 💁‍♂️ More info about the release at github.com/argilla-io/a... #AI #MachineLearning #OpenSource #DataScience #HuggingFace #Argilla

Daniel Vila reposted

🔥 We got great feedback on this: "Synthetic Data Generator" A no-code tool to create datasets with LLMs, making it a breeze, allowing ANYONE to create datasets and models in minutes and without any code. Blog: https://buff.ly/4gybyoT GitHub: https://buff.ly/49IDSmd Space: https://buff.ly/3Y1S99z

buff.lyIntroducing the Synthetic Data Generator - Build Datasets with Natural LanguageWe’re on a journey to advance and democratize artificial intelligence through open source and open science.

Daniel Vila reposted

Daniel Vila reposted

I've been building a small library for working with prompt templates on the @huggingface.bsky.social Hub: `pip install prompt-templates`. Motivation: The community currently shares prompt templates in a wide variety of formats: in datasets, in model cards, as strings in .py files, as .txt/... 🧵

Help shape the future of multilingual Open Source AI! Join the FineWeb 2 Community Annotation Sprint to create an open training dataset with full transparency and human validation in many languages. Review datasets in your language and help identify the best sources for training.

Daniel Vila reposted

👐 Open Image Preferences is an Apache 2.0 licensed dataset for text-to-image generation by the @hf.co community. This dataset contains 10K text-to-image preference pairs across image generation categories, using different model families and prompt complexities. Blog: huggingface.co/blog/image-p...

huggingface.coOpen Preference Dataset for Text-to-Image Generation by the 🤗 CommunityWe’re on a journey to advance and democratize artificial intelligence through open source and open science.

Daniel Vila reposted

Open Image Preferences released! 🚀 - Open-source dataset for text2image - 10K samples manually evaluated by the HF community. - Binarized format for SFT, DPO, or ORPO. It comes with a nice blog post explaining the steps to pre-process and generate the data, along with the results.

Announcing Global-MMLU - an improved MMLU Open dataset with evaluation coverage across 42 languages. The result of months of work with the goal of advancing Multilingual LLM evaluation. Built together with the community and amazing collaborators at Cohere4AI, MILA, MIT, and many more.

We're about to launch the biggest collaboration effort since the Open Assistant. Let's get the highest quality data for open foundation models with all the nuances & diversity of each language, all with data provenance and transparency Join us as language lead: docs.google.com/forms/d/10XI...

docs.google.comLanguage Lead sign-upAt Hugging Face 🤗, we're launching a big community initiative to improve LLM training for many languages. We're looking for Language Leads to help us cultivate specific languages during this initiativ...

Daniel Vila reposted

Next week we're launching a collaborative annotation effort to build a big multilingual dataset, so you can have high-quality data in your language. We are really close to getting leads for 100 languages! Can you help us cover the remaining 200?

Daniel Vila reposted

🙌 I just wanted to share a few thoughts about the latest Argilla release, 2.5.0, as it's a pretty big one! Argilla now has full support for webhooks, which means you can do some pretty cool stuff, like model training on the fly as annotations are created. 🤯 #MachineLearning #NLP #DataLabeling

Daniel Vila reposted

[SATURDAY THREAD] ☕️ 🧑‍🎓 In case you spent the week reading GDPR legislation and missed everything. It’s all about vision language models and image preference datasets. >> 🧵 Here are the models and datasets you can use in your projects.

Daniel Vila reposted

Recently, I added a feature to #Argilla to optimize plugin loading 🎉. It removes unnecessary code, improves readability, and lets future plugins load automatically. 🚀 Check out the PR 👇 and make your first contribution to our repo. github.com/argilla-io/a... #dev_experience #clean_code

github.com🔥 Improve plugins loaders by damianpumar · Pull Request #5697 · argilla-io/argillaRemove duplicated names Improve the way to load plugins and extensions Auto loading new plugins Convert to typescript Delete unused directive

Daniel Vila reposted

🚀 We’re excited to announce Argilla v2.5.0, which includes: * Argilla webhooks, * A new design for the datasets home page. * Python 3.13 and Pydantic v2 support. 📙 Read here 👇 the full release notes github.com/argilla-io/a...

github.comRelease v2.5.0 · argilla-io/argilla🔆 Release highlights Webhooks You can now create and manage webhooks to support your workflows! Webhooks allow you to submit real-time information to other applications whenever a specific event oc...

Daniel Vila reposted

A dataset of 1 million or 2 million Bluesky posts is completely irrelevant to training large language models. The primary usecase for the datasets that people are losing their shit over isn't ChatGPT, it's social science research and developing systems that improve Bluesky.

Jeremy Howard @howard.fm

Did you know that 99% of email today is spam? Your inbox isn’t 99% spam because AI is used to filter it. The same 99% will happen here too, but if AI researchers continue to get perma-banned for making available the datasets needed to filter it, it’s going to make this platform unusable.

Daniel Vila reposted

The best path forward in AI requires technologists to be reflective/self-critical about how their work impacts society. Transparency helps this. Appreciate Bsky for flagging AI ethics &my colleague’s response. Let’s make informed consent a real thing. More later; Recommend: bsky.app/profile/cfie...

Daniel van Strien@danielvanstrien.bsky.social

I've removed the Bluesky data from the repo. While I wanted to support tool development for the platform, I recognize this approach violated principles of transparency and consent in data collection. I apologize for this mistake.

Daniel Vila reposted

I've removed the Bluesky data from the repo. While I wanted to support tool development for the platform, I recognize this approach violated principles of transparency and consent in data collection. I apologize for this mistake.

Daniel van Strien@danielvanstrien.bsky.social

First dataset for the new @huggingface.bsky.social @bsky.app community organisation: one-million-bluesky-posts 🦋 📊 1M public posts from Bluesky's firehose API 🔍 Includes text, metadata, and language predictions 🔬 Perfect to experiment with using ML for Bluesky 🤗 huggingface.co/datasets/blu...

Daniel Vila reposted

The community has labelled over 3000 image preferences in a few hours. One open source image preferences dataset coming right up!

Ben Burtenshaw@benburtenshaw.bsky.social

Let’s make a generation of amazing open source image generation models from high quality data. The best image generation models train on human preferences. Unfortunately, many of these datasets are closed. Let’s change that! 🧵 we're building a community dataset and we need help reviewing!

Daniel Vila reposted

At @huggingface.bsky.social 🤗 we're preparing a collaborative annotation effort to build an open-source multilingual dataset. If you'd like to get high-quality open data for your language, check if yours is listed in this form and sign up! forms.gle/DHJdtvoSNxAA...

forms.gleLanguage Lead sign-upAt Hugging Face 🤗, we're launching a big community initiative to improve LLM training for many languages. We're looking for Language Leads to help us cultivate specific languages during this initiativ...

Daniel Vila reposted

First dataset for the new @huggingface.bsky.social @bsky.app community organisation: one-million-bluesky-posts 🦋 📊 1M public posts from Bluesky's firehose API 🔍 Includes text, metadata, and language predictions 🔬 Perfect to experiment with using ML for Bluesky 🤗 huggingface.co/datasets/blu...

huggingface.cobluesky-community/one-million-bluesky-posts · Datasets at Hugging FaceWe’re on a journey to advance and democratize artificial intelligence through open source and open science.

Daniel Vila reposted

Did you know that on Argilla, we’re adding a new feature to export labeled datasets directly to the Hugging Face Hub? 🤔 We’re leveraging the Hugging Face datasets library for seamless integration, including defining span labeling Stay tuned for the release!🧠✨ #MachineLearning #NLP #DataLabeling

Daniel Vila reposted

👀 Who said the Argilla tool was only for text? I am proud of my brilliant teammates for setting up this significant initiative 🤗 @benburtenshaw.bsky.social @davidberenstein.bsky.social @danielvanstrien.bsky.social @dvilasuero.hf.co

Ben Burtenshaw@benburtenshaw.bsky.social

Let’s make a generation of amazing open source image generation models from high quality data. The best image generation models train on human preferences. Unfortunately, many of these datasets are closed. Let’s change that! 🧵 we're building a community dataset and we need help reviewing!

Daniel Vila reposted

Glad to see HF do this initiative for training models

Daniel Vila@dvilasuero.hf.co

Let's make AI more inclusive. At @huggingface.bsky.social we'll launch a huge community sprint soon to build high-quality training datasets for many languages. We're looking for Language Leads to help with outreach. Find your language and nominate yourself: forms.gle/iAJVauUQ3FN8...

Contributing to the task itself will be easy as well, with no programming skills required, just reading short documents in the language and rating them according to their educational quality for training AI models

Daniel Vila reposted

ICYMI, my colleague @dvilasuero.hf.co created a feed you can use to keep up to date on 🤗 datasets. Pin it!

Daniel Vila@dvilasuero.hf.co

Interested in open datasets for ML and AI? I've just created this feed with posts about @huggingface.bsky.social datasets! Don't miss the latest news and conversations about the secret sauce behind every AI model. bsky.app/profile/dvil...