Community Post: Part 3 - Delta Lake 3.0 is like an electric car charging standard
- The power of open source
- Delta Lake 3.0 is just one example
- Parquet-based data lakehouse file format
- Similar to electric car charging standard
A well-received community post I recently made:
https://www.linkedin.com/posts/erikgfesser_snowflake-deltalake-iceberg-activity-7080482215016476672-Xrh0
Just over two months ago in mid-April of this year, I couldn't help but notice this car parked in front of me as I loaded the groceries I had just picked up at one of the three local grocery stores that I frequent on a weekly basis in the western suburbs of Chicago (Jewel-Osco, the other two being Whole Foods and Pete's Fresh Market).
"What's with the Snowflake-branded Suzuki?", I initially asked myself.
Of course, I immediately checked out the side of the car, immediately seeing that the owner was actually a snow removal firm (no, I'm not going to go there with this post).
After my morning run today, I came across another recently-written article about the upcoming release of DeltaLake 3.0 and its compatibility with Iceberg and Hudi, and I couldn't help but draw a mental connection with this Suzuki and all of the recent press about the snowballing adoption rate of NACS (North American Charging Standard) versus CCS (Combined Charging Standard) for electric car charging.
What do we see Tesla competitors doing? Well, in recognition that NACS has become the de facto standard for electric car charging, regardless of whether it has actually been the "true" standard, adapters have been increasingly offered to conform to this standard.
In the world of data architecture, Delta Lake will continue to be increasingly adopted as the standard Parquet-based file format for the data lakehouse, and Databricks is now accelerating adoption by building adapters to make use of it, providing much-needed compatibility.
Other competing data platforms such as Microsoft Fabric will build on this foundation, but Delta Lake will be in the driver's seat (to use the analogy) for what is arguably at front and center of modern data platforms, somewhat similar to the Tesla charging network. This is the power of open source software.