Clem Delangue 🤗

Clem Delangue 🤗

@clem.hf.co

Co-founder and CEO at Hugging Face

3.5K followers143 following23 posts

Just 10 days after o1's public debut, we’re thrilled to unveil the open-source version of the technique behind its success: scaling test-time compute By giving models more "time to think," Llama 1B outperforms Llama 8B in math—beating a model 8x its size. The full recipe is open-source!

Clem Delangue 🤗 reposted

Announcing 🥂 FineWeb2: A sparkling update with 1000s of 🗣️languages. We applied the same data-driven approach that led to SOTA English performance in🍷 FineWeb to thousands of languages. 🥂 FineWeb2 has 8TB of compressed text data and outperforms other datasets.

Clem Delangue 🤗 reposted

The FineWeb team is happy to finally release "FineWeb2" 🥂🥳 FineWeb 2 extends the data driven approach to pre-training dataset design that was introduced in FineWeb 1 to now covers 1893 languages/scripts Details: huggingface.co/datasets/Hug... A detailed open-science tech report is coming soon

Clem Delangue 🤗 reposted

I would put this even more strongly: open source AI is probably our only realistic chance to avoid a terrifying increase in concentration of power. I do not want to live in a world where the people with all the money also have all the intellectual power.

Nathan Lambert@natolambert.bsky.social

The most realistic reason to be pro open source AI is to reduce concentration of power.

Clem Delangue 🤗 reposted

This demo of structured data extraction running on an LLM that executes entirely in the browser (Chrome only for the moment since it uses WebGPU) is amazing My notes here: simonwillison.net/2024/Nov/29/...

simonwillison.netStructured Generation w/ SmolLM2 running in browser & WebGPUExtraordinary demo by Vaibhav Srivastav. Here's Hugging Face's [SmolLM2-1.7B-Instruct](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B-Instruct) running directly in a web browser (using WebGPU, so r...
vb@reach-vb.hf.co

To showcase how much you can do with just a 1.7B LLM, you pass free text, define a schema of parsing the text into a GitHub issue (title, description, categories, tags, etc) - Let MLC & XGrammar do the rest! That's it, the code is super readable, try it out today! 🤗 huggingface.co/spaces/reach...

Clem Delangue 🤗 reposted

Wasn't going to wade into this but... as long as the internet exists in an open form, scraping will exist, and that's kind of the whole point... APIs exist because interacting with data is valuable and scraping (the old fashioned way) is annoying.

For me, the biggest risk in AI is centralization of power and benefits in the hands of a few. This is why at @hf.co, we've been investing on building online courses for as many people as possible to understand and learn to build AI themselves. You can find some of them here: huggingface.co/learn

Clem Delangue 🤗 reposted

I’m thankful for everyone using Bluesky, everyone building on atproto, everyone listening to our message and sharing our dream of a better social media ecosystem that puts people first. We’re going to do this together — thanks for joining us on this journey!

Clem Delangue 🤗 reposted

A dataset of 1 million or 2 million Bluesky posts is completely irrelevant to training large language models. The primary usecase for the datasets that people are losing their shit over isn't ChatGPT, it's social science research and developing systems that improve Bluesky.

Jeremy Howard @howard.fm

Did you know that 99% of email today is spam? Your inbox isn’t 99% spam because AI is used to filter it. The same 99% will happen here too, but if AI researchers continue to get perma-banned for making available the datasets needed to filter it, it’s going to make this platform unusable.

Clem Delangue 🤗 reposted

Did you know that 99% of email today is spam? Your inbox isn’t 99% spam because AI is used to filter it. The same 99% will happen here too, but if AI researchers continue to get perma-banned for making available the datasets needed to filter it, it’s going to make this platform unusable.

Clem Delangue 🤗 reposted

Hi, so I've spent the past almost-decade studying research uses of public social media data, like e.g. ML researchers using content from Twitter, Reddit, and Mastodon. Anyway, buckle up this is about to be a VERY long thread with lots of thoughts and links to papers. 🧵

Daniel van Strien@danielvanstrien.bsky.social

First dataset for the new @huggingface.bsky.social @bsky.app community organisation: one-million-bluesky-posts 🦋 📊 1M public posts from Bluesky's firehose API 🔍 Includes text, metadata, and language predictions 🔬 Perfect to experiment with using ML for Bluesky 🤗 huggingface.co/datasets/blu...

Clem Delangue 🤗 reposted

Good move by @danielvanstrien.bsky.social to apologize & remove the dataset IMO. Let's find ways to fight concentration of power in the hands of proprietary/commercial actors (who are certainly using all the public data they can find w/o telling you) while also fostering consent & attribution.

Daniel van Strien@danielvanstrien.bsky.social

I've removed the Bluesky data from the repo. While I wanted to support tool development for the platform, I recognize this approach violated principles of transparency and consent in data collection. I apologize for this mistake.

Clem Delangue 🤗 reposted

Let's go! We are releasing SmolVLM, a smol 2B VLM built for on-device inference that outperforms all models at similar GPU RAM usage and tokens throughputs. SmolVLM can be fine-tuned on a Google collab and be run on a laptop! Or process millions of documents with a consumer GPU!

Clem Delangue 🤗 reposted

First dataset for the new @huggingface.bsky.social @bsky.app community organisation: one-million-bluesky-posts 🦋 📊 1M public posts from Bluesky's firehose API 🔍 Includes text, metadata, and language predictions 🔬 Perfect to experiment with using ML for Bluesky 🤗 huggingface.co/datasets/blu...

huggingface.cobluesky-community/one-million-bluesky-posts · Datasets at Hugging FaceWe’re on a journey to advance and democratize artificial intelligence through open source and open science.

I've been in Brazil for 10 days now 🇧🇷🇧🇷🇧🇷 I've been surprised by the gap between the massive number of people interested in AI (chatgpt adoption is crazy here) and the relatively low number of real AI builders - aka people and companies building their own AI models, datasets and apps.

Lots of efforts needed across the world for everyone to participate, control and benefit this foundational technology, starting with open-source & multi-lingual AI, more access to GPUs & AI builder training for all!

Clem Delangue 🤗 reposted

It's Sunday morning so taking a minute for a nerdy thread (on math, tokenizers and LLMs) of the work of our intern Garreth By adding a few lines of code to the base Llama 3 tokenizer, he got a free boost in arithmetic performance 😮 [thread]

Clem Delangue 🤗 reposted

We created these values as a team, and we live them as a team 💪

Emily Witko@witko.bsky.social

We're big on transparency and love all things open at @huggingface.bsky.social so we thought, why not share our internal mission, vision, and values with everyone? Take a read and let us know what you think! It's such a special place!

Clem Delangue 🤗 reposted

Clem Delangue 🤗 reposted

Introducing Transformers.js v3: State-of-the-art Machine Learning for the Web. New features include: ⚡ WebGPU support (up to 100x faster than WASM) 🔢 New quantization formats 🏛 121 supported architectures in total 🤖 Over 1200 pre-converted models Get started with `npm i @huggingface/transformers`