Meeting Summary for Geoparquet & friends (arrow, iceberg, etc) meet up

[Tim Welch via Otter.ai]

Tim Welch has shared notes from Geoparquet & friends (arrow, iceberg, etc) meet up, Feb 24 . The meeting focused on the integration and future of GeoParquet and related technologies. Key points included the recent addition of geometry and geography data types to Parquet and Iceberg, with discussions on compatibility and implementation challenges. Jia Yu highlighted ongoing work on C++ and Java implementations of Parquet Geo Data tab and Iceberg Geo support. The team discussed the potential for a GeoParquet 2.0 spec that includes both new data types and metadata, but noted compatibility issues with non-prepared Parquet readers. The group emphasized the need for a matrix to track reader behavior and ensure smooth transitions. View in Otter → Geoparquet & friends (arrow, iceberg, etc) meet up Feb 24, 10:49 am, 30 min   The meeting focused on the integration and future of GeoParquet and related technologies. Key points included the recent addition of geometry and geography data types to Parquet and Iceberg, with discussions on compatibility and implementation challenges. Jia Yu highlighted ongoing work on C++ and Java implementations of Parquet Geo Data tab and Iceberg Geo support. The team discussed the potential for a GeoParquet 2.0 spec that includes both new data types and metadata, but noted compatibility issues with non-prepared Parquet readers. The group emphasized the need for a matrix to track reader behavior and ensure smooth transitions. See full summary →   Action items Coordinate with Parquet and Iceberg implementers to ensure a fallback or compatibility mechanism is in place for the new geospatial data types. Explore the feasibility of creating a "GeoParquet 2.0" format that can be compatible with both the new native Parquet types and the existing GeoParquet metadata. Investigate the behavior of different Parquet readers when encountering the new geometry and geography data types, and document the findings. See 4 action items → Tim is automating meeting notes. Try it for your own meetings! Get started for free →   Otter.ai, 800 W El Camino Real, Suite 170 Mountain View, CA 94040 Email settings   Unsubscribe

[Prayitno - via Otter.ai]

Prayitno - has shared notes from Geoparquet & friends (arrow, iceberg, etc) meet up, Feb 24 . The meeting focused on the integration and future of GeoParquet and related technologies. Key points included the recent addition of geometry and geography data types to Parquet and Iceberg, marking GeoParquet 2.0. Discussions highlighted the need for compatibility between different versions of GeoParquet and the challenges of ensuring non-prepared Parquet readers can handle new data types. The group emphasized the importance of a comprehensive test plan involving major engines to validate compatibility. They also touched on the potential for extending GeoParquet to raster data and the need for best practices around compression levels.

View in Otter →

Geoparquet & friends (arrow, iceberg, etc) meet up

Feb 24, 10:50 am, 35 min   The meeting focused on the integration and future of GeoParquet and related technologies. Key points included the recent addition of geometry and geography data types to Parquet and Iceberg, marking GeoParquet 2.0. Discussions highlighted the need for compatibility between different versions of GeoParquet and the challenges of ensuring non-prepared Parquet readers can handle new data types. The group emphasized the importance of a comprehensive test plan involving major engines to validate compatibility. They also touched on the potential for extending GeoParquet to raster data and the need for best practices around compression levels. See full summary →   Action items Create a compatibility matrix for the major Parquet readers and their behavior when encountering the new geometry and geography data types. Publish a blog post on the transition from GeoParquet to native Parquet support for geometry and geography data types. Investigate the possibility of creating Parquet 2.0 files that are compatible with GeoParquet 1.1 and 1.0 metadata. See 5 action items →   See 18 images → Prayitno is automating meeting notes. Try it for your own meetings!

Get started for free →

Otter.ai, 800 W El Camino Real, Suite 170 Mountain View, CA 94040 Email settings   Unsubscribe