For everyone interested in data infra, want to get a quick sense of how big data works, how data systems are designed, and what the tradeoffs are, start with this share from @xiangpeng.systems, really nice intro! intro-data-system.xiangpeng.systems
Xuanwo
Xuanwo
@xuanwo.io
ASF Member. Apache OpenDAL PMC Chair. VISION: Data Freedom. Working on #RBIR. More: https://bento.me/xuanwo
1.9K followers116 following192 posts
I'm happy to announce that @apache.org has refined its release policy, clarifying that expedited releases are permitted in certain circumstances. Let's bring more good changes🥰
My original post is here: xuanwo.io/links/2025/0... The policy discussion took place internally. The changes can be seen at github.com/apache/www-s....
@xiangpeng.systems shared a great post about system researchers. I wrote a comment on it and would like to share some thoughts here and offer complementary ideas. In short: build paper with open source. xuanwo.io/links/2025/0...
I shared a post about mcp-server-opendal along with a simple explanation of what the Model Context Protocol is. Post: xuanwo.io/links/2025/0... Repo: github.com/Xuanwo/mcp-s...
opendal.apache.org/blog/2025/03... Apache OpenDAL 2025 Roadmap: Perfecting Production Adoption
Archlinux announced that they will remove the deprecated repository and now it effected. Please go check your /etc/pacman.conf and remove the section that is deprecated. xuanwo.io/links/2025/0...
With @andrewlamb1111.bsky.social 's help, I assisted the Arrow Rust community in releasing Arrow Rust 54.2.1 within six hours. I shared what I learned during this process, which I believe could benefit other ASF projects in handling similar cases. xuanwo.io/links/2025/0...
Happy to read zlib-rs is faster than C from @trifectatech.bsky.social. I read that post and took some notes on SIMD instructions and DFA jump threading. Feel free to check them out! xuanwo.io/links/2025/0...
The AWS S3 SDK breaks its compatible services by enforcing integrity checksums. This reminds me of another key advantage of Apache OpenDAL: it's not controlled by any storage vendor. xuanwo.io/links/2025/0...
Xuanwo reposted
Chris Riccomini (@chris.blue) shares his thoughts on Open Source foundations: Apache, CNCF, Commonhaus. He also explains why Commonhaus is a better fit for SlateDB cnr.sh/posts/compar...
I am happy to announce the release of BackON v1.4.0. BackON has been used by 1.1k projects on github, and been downloaded for 20k times per day. Really nice! xuanwo.io/links/2025/0...
Really appreciate @github.com and @glich.stream 's help with OpenDAL's GHAC service migration. xuanwo.io/links/2025/0...
duckdb is the best TPC data generator! Don't bother building dsdgen—just use @duckdb.org instead. xuanwo.io/links/2025/0...
Personal software has been trending recently. I enjoyed reading @leerob.com's "personal software" and @edmarferreira.bsky.social 's "selfish software". Hope you enjoy them too! xuanwo.io/links/2025/0...
"Cloud virtualization: Red Hat, AWS Firecracker, and Ubicloud internals" provides a great conclusion to cloud virtualization in the 2020s. Reading this post will give you a good understanding of the current state of cloud virtualization. Highly recommended. xuanwo.io/links/2025/0...
I decided to follow @simonwillison.net's approach to creating a link blog, where I can share interesting links I find on the internet along with my own comments and thoughts about them. xuanwo.io/links/2025/0...
Maybe we can build a tool based on opendal to find the best object storage key pattern for given storage services? github.com/apache/opend...
The next version of OpenDAL will be "v0.51.1 - Look, a New Day Has Begun," a famous line from Cats Musical. Hoping you all find happiness in the coming new year ❤️ github.com/apache/opend...
New Post: A letter to open-source maintainers Hoping maintainers can find happiness in open source. xuanwo.io/2024/10-a-le...
Hello, bluesky. The recording of my CMU-DB's Building Blocks Seminar Talk about OpenDAL is online now. If you have any questions about OpenDAL or are looking for collaboration, feel free to DM me! www.youtube.com/watch?v=eVMI...
Hello everyone, the first Iceberg #Rust Community Sync will happen at 28th Nov (today!) at 23:00 UTC+8. Welcome to join us! docs.google.com/document/d/1...
For those interested in learning more about Apache Hudi, consider reading "Apache Hudi: From Zero To One" written by Shiyan Xu (One of Hudi PMC Member) blog.datumagic.com/p/apache-hud...
When something like Redis is so widely used that it becomes an informal standard, how should the open-source community engage with the original author? This discussion is worth joining, and I look forward to your comments. Thank @mitsuhiko.at for setting up the context. github.com/redis-rs/red...
Rust Edition 2024 scheduled to be released on February 20, 2025. Nice! github.com/rust-lang/ru...
Wow, just find @andrewlamb1111.bsky.social is on bluesky, happy to see! Follow him if you are interested in rust, database, arrow and datafusion 😍
backon is a lib that makes retry like a built-in feature provided by #Rust. I'm excited to announce the release of v1.3.0, which includes several quality-of-life improvements. Enjoy! github.com/Xuanwo/backo...
Has AWS S3 changed its leadership or something? This year, S3 has undergone so many changes that it seems like they've undone progress from the past 10 years. - Deprecated SelectObject - Added AppendObject (directory bucket only) - Introduced PutObject if none exist
That's huge. Created an OpenDAL issue for it: github.com/apache/opend...
That's huge. Created an OpenDAL issue for it: github.com/apache/opend...
Amazon S3 just grew "append"! It's only available for the more expensive, lower latency S3 Express One Zone bucket class but you can now append data to an object up to 10,000 times - previously you could only atomically replace a whole object with an updated version simonwillison.net/2024/Nov/22/...
Publishing a post "What Did ASF Do Wrong?" to explore ways to attract more contributors—feel free to join the discussion with me. xuanwo.io/2024/09-what...
Thank you @craigkerstiens.com and @chris.blue for the suggestions. It’s quite interesting to know more databases 👋