Kyle Barron

Kyle Barron

@kylebarron.dev

Creating the next generation of geospatial data tools for Python & the browser with GeoArrow, GeoParquet & GeoRust @developmentseed | he/him 🌈

737 followers336 following103 posts

Kyle Barron reposted

It saddens me to report that: - There's an ongoing LinkedIn beef around attribution in open source projects, and - I pay attention to LinkedIn I have ... thoughts. I want to avoid the LinkedIn blast radius (for now) so this seemed like a better venue in which to float these thoughts. Here we go...

Kyle Barron reposted

An interactive geotiff viewer extension for #vscode / #positron powered by @kylebarron.dev's amazing deck.gl-raster. Just click on a tif file and take a peek. Early days but give it a spin and let me know if there are any issues. ✌️ github.com/belian-earth...

github.comGitHub - belian-earth/rastereye: Quick GeoTIFF viewer for VS Code and PositronQuick GeoTIFF viewer for VS Code and Positron. Contribute to belian-earth/rastereye development by creating an account on GitHub.

𝐝𝐞𝐜𝐤.𝐠𝐥-𝐫𝐚𝐬𝐭𝐞𝐫 𝐯0.3: fast GeoTIFF visualization in deck.gl - 𝐍𝐞𝐰 𝐓𝐲𝐩𝐞𝐒𝐜𝐫𝐢𝐩𝐭 𝐆𝐞𝐨𝐓𝐈𝐅𝐅 𝐥𝐢𝐛𝐫𝐚𝐫𝐲: high-level & fully-typed. We've fully migrated off of geotiff.js - 𝐀𝐮𝐭𝐨 𝐍𝐨𝐝𝐚𝐭𝐚 𝐦𝐚𝐬𝐤𝐢𝐧𝐠 - 𝐂𝐨𝐦𝐩𝐫𝐞𝐬𝐬𝐞𝐝 𝐄𝐏𝐒𝐆 𝐝𝐚𝐭𝐚𝐛𝐚𝐬𝐞 to 309kb - 𝐍𝐞𝐰 𝐩𝐨𝐫𝐭𝐬 of Affine and Morecantile to TS developmentseed.org/deck.gl-rast...

Building on Vincent Sarago's work, I updated and published 𝐚𝐬𝐲𝐧𝐜-𝐩𝐦𝐭𝐢𝐥𝐞𝐬, an asynchronous PMTiles reader for Python: github.com/developments... This integrates with Obstore for efficiently reading remote files and Obspec for extensibility.

github.comGitHub - developmentseed/async-pmtiles: Asynchronous PMTiles reader for PythonAsynchronous PMTiles reader for Python. Contribute to developmentseed/async-pmtiles development by creating an account on GitHub.

Published a new version of async-geotiff: - Support for reading band-interleaved GeoTIFFs and Cloud-Optimized GeoTIFFs - Initial support for decoding LERC, LERC_DEFLATE, LERC_ZSTD images - Fix computation of image bounds and resolution for rotated images github.com/developments...

github.comRelease v0.2.0 · developmentseed/async-geotiffNew Features feat: Support for band-interleaved data by @kylebarron in #80 feat: Add LERC decompression support by @kylebarron in #79 Fixes fix: Fix computation of bounds and res for rotated dat...

Introducing 𝐀𝐬𝐲𝐧𝐜-𝐆𝐞𝐨𝐓𝐈𝐅𝐅, a new library for reading GeoTIFFs and COGs. developmentseed.org/async-geotif... - Fast, with a Rust core - Uses a non-blocking thread pool for image decoding - Integrates with NumPy, PyProj, Affine & Morecantile - Remote data support with Obstore - No GDAL dependency

developmentseed.orgIntroducing Async-GeoTIFF - async-geotiffA fast, async GeoTIFF and Cloud-Optimized GeoTIFF (COG) reader for Python.

Kyle Barron reposted

wikipedia turns 25 today! the last unenshittified major website! backbone of online info! triumph of humanity! powered by urge of unpaid randos to correct each other! somehow mostly reliable! "good thing wikipedia works in practice, because it sure doesn't work in theory" - old wiki adage

Announcing deck.gl-raster: 𝐟𝐮𝐥𝐥𝐲 𝐜𝐥𝐢𝐞𝐧𝐭-𝐬𝐢𝐝𝐞 𝐂𝐎𝐆 𝐫𝐞𝐧𝐝𝐞𝐫𝐢𝐧𝐠. No server required. 1.3 𝐠𝐢𝐠𝐚𝐛𝐲𝐭𝐞 COG, streamed directly into the browser: developmentseed.org/deck.gl-rast... - GPU-accelerated raster reprojection - GPU image processing for colormaps, nodata values - Efficient use of COG overviews

Kyle Barron reposted

View full thread

Published a new version of parquet-wasm: github.com/kylebarron/p... - Update to latest version of Rust parquet crate - Workaround to read Parquet data containing Arrow string view/binary view types - Streaming writes - Comparison between parquet-wasm and hyparquet, a pure-JavaScript Parquet reader

github.comRelease v0.7.0 · kylebarron/parquet-wasmWhat's Changed Streaming Writes implementation by @H-Plus-Time in #305 Expose schema on ParquetFile by @H-Plus-Time in #599 Small doc fixes by @severo in #762 Bump to arrow/parquet 56 by @kylebarr...

Published arro3-core v0.6 with wider dtype support for converting numpy ndarrays to Arrow. It now additionally supports: - datetime64 - timedelta64 - fixed-width strings/bytes - variable-width strings - object arrays of str/bytes And the Python wheel is still just 2.5MB! github.com/kylebarron/a...

github.comRelease py-v0.6.0 · kylebarron/arro3arro3-core Breaking Changes 🔧 No breaking changes. New features ✨ Expanded dtype support in Array.from_numpy. It now additionally supports datetime64, timedelta64, fixed-width strings and bytes, v...

I'll be speaking at the NYC DataFusion meetup in September on geospatial support for DataFusion! lu.ma/qkcyycg0 DataFusion is a Rust-based query engine for building fast OLAP data processing systems. Compared to DuckDB, DataFusion is more modular and is designed to be embedded in larger systems.

lu.maNew York City Apache DataFusion Meetup · LumaWelcome to the New York City Apache DataFusion Meetup! Join us for an evening of talks, panel discussion, and community discussion celebrating 50 releases of…