Meeting Summary for Geoparquet & friends (arrow, iceberg, etc) meet up

0 views
Skip to first unread message

Prayitno - via Otter.ai

unread,
Dec 16, 2024, 2:11:03 PM12/16/24
to geoparquet...@cloudnativegeo.org
Prayitno - has shared notes from Geoparquet & friends (arrow, iceberg, etc) meet up, Dec 16 . The meeting focused on the integration and adoption of GeoParquet and related technologies. Key points included the discussion of the iceberg PR, which addresses the inclusion of non-spherical edge types, and the implications for GeoParquet. Databricks' implementation of exact geodesic edges was highlighted, noting the lack of an exact geodesic edge calculation. The conversation also covered the benefits of using well-known binary encoding for points in parquet files, which could improve performance. The need for a new GeoParquet release to align with GeoArrow 0.2 and the potential performance advantages of binary encoding over native types were also discussed.
Otter.ai logo
View in Otter →

Geoparquet & friends (arrow, iceberg, etc) meet up

Dec 16, 9:50 am, 42 min

 

The meeting focused on the integration and adoption of GeoParquet and related technologies. Key points included the discussion of the iceberg PR, which addresses the inclusion of non-spherical edge types, and the implications for GeoParquet. Databricks' implementation of exact geodesic edges was highlighted, noting the lack of an exact geodesic edge calculation. The conversation also covered the benefits of using well-known binary encoding for points in parquet files, which could improve performance. The need for a new GeoParquet release to align with GeoArrow 0.2 and the potential performance advantages of binary encoding over native types were also discussed.

See full summary →

 

Action items

Continue to monitor the progress of the Iceberg V3 specification and coordinate the Geoparquet integration.
Investigate support for Geoarrow native types, especially for point data, in tools like the DB.
Push for adoption of Geoarrow native types, particularly for point data, in the Geoparquet community.

See 3 action items →

 

Get more insights from this meeting

Write follow-up email

What are the next steps for the Geoparquet community to address market demands and include new features in the upcoming release?

What are the key performance considerations for adopting Geoarrow native types, especially for point data, in Geoparquet?

Ask questions with Otter AI Chat →

 
Prayitno is automating meeting notes. Try it for your own meetings!



 
Otter.ai, 800 W El Camino Real, Suite 170 Mountain View, CA 94040
Email settings   Unsubscribe
 

Yves Moisan via Otter.ai

unread,
Dec 16, 2024, 2:21:43 PM12/16/24
to geoparquet...@cloudnativegeo.org
Yves Moisan has shared notes from Geoparquet & friends (arrow, iceberg, etc) meet up, Dec 16 . The meeting focused on the integration and development of GeoParquet and related technologies like Arrow and Iceberg. Key points included the discussion of edge types in GeoParquet, with a focus on spherical and geodesic approximations, and the implications for data models like Databricks and Snowflake. The conversation also covered the addition of new geometry types in GeoArrow, the benefits of point encoding in Parquet, and the need for alignment with Iceberg's specifications. The team emphasized the importance of performance and interoperability, particularly for spatial data, and discussed potential future releases and enhancements.
Otter.ai logo
View in Otter →

Geoparquet & friends (arrow, iceberg, etc) meet up

Dec 16, 9:50 am, 42 min

 

The meeting focused on the integration and development of GeoParquet and related technologies like Arrow and Iceberg. Key points included the discussion of edge types in GeoParquet, with a focus on spherical and geodesic approximations, and the implications for data models like Databricks and Snowflake. The conversation also covered the addition of new geometry types in GeoArrow, the benefits of point encoding in Parquet, and the need for alignment with Iceberg's specifications. The team emphasized the importance of performance and interoperability, particularly for spatial data, and discussed potential future releases and enhancements.

See full summary →

 

Action items

Jed Sundwall – Explore releasing larger sample datasets to drive adoption of Gia Arrow native types in Geoparquet.
Follow up on the status of Iceberg v3 specification release.
Investigate support for Gia Arrow native types, especially for point data, in tools like Databricks.

See 3 action items →

 

See 2 images →

Yves is automating meeting notes. Try it for your own meetings!
 
Otter.ai, 800 W El Camino Real, Suite 170 Mountain View, CA 94040
Email settings   Unsubscribe
 
Reply all
Reply to author
Forward
0 new messages