Did you know that, since #DuckDB v0.10.3 (~May 2024), you can point a SELECT at a dataset on the Hugging Face Hub, using the DuckDB `hf://` protocol, and query it, without downloading it first? 🤗 🦆 This blog post covers how that Hugging Face + DuckDB integration works and the use cases it fits:
duckdb.orgDuckDB and Hugging Face: Querying Datasets DirectlyHugging Face hosts hundreds of thousands of datasets, and DuckDB can read them directly, exactly where they are and without downloading anything, over the DuckDB hf:// protocol. This post looks at how...
3 reposts20 likes