Meeting Summary for Geoparquet & friends (arrow, iceberg, etc) meet up

[Yves Moisan via Otter.ai]

Yves Moisan has shared notes from Geoparquet & friends (arrow, iceberg, etc) meet up, Jan 27 . The meeting discussed updates on GeoParquet and related projects. Mike introduced himself as the new CTO at Kato, rejoining after a stint at Meta. Updates included the progress on the iceberg geometry PR, with issues around CRS propagation in DuckDB and Sedona. Jia mentioned the speaker partition project wrapping up soon. The team discussed the challenges of handling large datasets, such as the 26 GB USGS dataset transformed to GeoParquet and loaded into BigQuery. They also explored the potential for extending GeoParquet to handle raster data and the complexities of data models in iceberg and parquet. View in Otter → Geoparquet & friends (arrow, iceberg, etc) meet up Jan 27, 9:51 am, 42 min   The meeting discussed updates on GeoParquet and related projects. Mike introduced himself as the new CTO at Kato, rejoining after a stint at Meta. Updates included the progress on the iceberg geometry PR, with issues around CRS propagation in DuckDB and Sedona. Jia mentioned the speaker partition project wrapping up soon. The team discussed the challenges of handling large datasets, such as the 26 GB USGS dataset transformed to GeoParquet and loaded into BigQuery. They also explored the potential for extending GeoParquet to handle raster data and the complexities of data models in iceberg and parquet. See full summary →   Action items Jed Sundwall – Finalize the Geoparquet tools project and make it available for installation. Decide on the OGC standards meeting request and coordinate with Scott/Goby. Implement the Spark partition without duplicates. See 5 action items →   See 7 images → Yves is automating meeting notes. Try it for your own meetings! Get started for free →   Otter.ai, 800 W El Camino Real, Suite 170 Mountain View, CA 94040 Email settings   Unsubscribe

[Prayitno - via Otter.ai]

Prayitno - has shared notes from Geoparquet & friends (arrow, iceberg, etc) meet up, Jan 27 . The meeting focused on updates and challenges related to GeoParquet and related technologies. Key points included the status of the iceberg geometry type PR, which is pending approval from Run Blue, and the importance of maintaining CRS (Coordinate Reference System) as a string. Mike, the new CTO at Kato, shared his recent work on GeoParquet tools for DuckDB, including spatial ordering checks and admin-style boundary partitioning. Jia discussed the complexities of loading a large hydrography dataset into BigQuery and the need for proper partitioning. The conversation also touched on the potential for standardizing raster data in GeoParquet and the challenges of implementing foreign key relationships in data lake systems.

View in Otter →

Geoparquet & friends (arrow, iceberg, etc) meet up

Jan 27, 9:54 am, 42 min   The meeting focused on updates and challenges related to GeoParquet and related technologies. Key points included the status of the iceberg geometry type PR, which is pending approval from Run Blue, and the importance of maintaining CRS (Coordinate Reference System) as a string. Mike, the new CTO at Kato, shared his recent work on GeoParquet tools for DuckDB, including spatial ordering checks and admin-style boundary partitioning. Jia discussed the complexities of loading a large hydrography dataset into BigQuery and the need for proper partitioning. The conversation also touched on the potential for standardizing raster data in GeoParquet and the challenges of implementing foreign key relationships in data lake systems. See full summary →   Action items Implement the admin-style boundary partitioning in the Geoparquet tools project. Add support for additional partitioning methods (e.g., Jake, Dewey's duckdb work) to the Geoparquet tools project. Decide on whether to have another meeting with the OGC to review the Geoparquet work. See 5 action items →   See 8 images → Prayitno is automating meeting notes. Try it for your own meetings!

Get started for free →

Otter.ai, 800 W El Camino Real, Suite 170 Mountain View, CA 94040 Email settings   Unsubscribe