Meeting Summary for Lance Community Sync

[Gunther Xing via Otter.ai]

Gunther Xing has shared notes from Lance Community Sync, Jun 18 . The Lance Community Sync discussed several key points. Prashanth Rao highlighted recent performance blogs on Lance DB, including metadata benchmarks and Spark materialization. Will Jones proposed using GitHub approvals for format changes to ensure thorough review, with three PMC votes required for merging. Xuanwo Ding suggested using Google Docs for design reviews to improve collaboration. Weston Pace emphasized the importance of maintaining backwards compatibility. Xuanwo also proposed a new shuffle format optimized for GPU, which Will Jones offered to review. Ragnor Comerford introduced a new RFC for a multi-table transaction approach, pending Jack's input. Hi, Here’s the recording, notes and actions from the meeting: Lance Community Sync If you’re interested in trying out Otter.ai for yourself, sign up for free here. – Gunther   Otter.ai, 800 W El Camino Real, Suite 170 Mountain View, CA 94040 Email settings   Unsubscribe

[波 方 via Otter.ai]

波 方 has shared notes from Lance Community Sync, Jun 18 . The Lance Community Sync discussed several key points. Xuanwo Ding suggested a bi-weekly release schedule. Performance blogs on Lance DB highlighted improvements in metadata benchmarks and data materialization. Will Jones proposed using GitHub approvals for format changes to streamline the review process, with a preference for keeping discussions in GitHub or Google Docs. Xuanwo Ding introduced a new shuffle format for GPU optimization, aiming to improve performance and reduce IOPS. Ragnor Comerford discussed a multi-table transaction approach, emphasizing the need for a branch-based system and potential contributions to the codebase. The team agreed to document their roadmap more publicly for community collaboration.

Hi, Here’s the recording, notes and actions from the meeting: Lance Community Sync If you’re interested in trying out Otter.ai for yourself, sign up for free here.

– 波

Otter.ai, 800 W El Camino Real, Suite 170 Mountain View, CA 94040 Email settings   Unsubscribe

[Drew G via Otter.ai]

Drew G has shared notes from Lance Community Sync, Jun 18 . The Lance Community Sync discussed the need for regular releases, with the last one taking over three weeks. Key points included the importance of format changes requiring three votes from the PMC, and proposals to use GitHub approvals for voting and move discussions to PRs. Xuanwo Ding suggested using Google Docs for design reviews to improve collaboration. Will Jones proposed a new shuffle format for GPU optimization, which was supported by Weston Pace and Xuanwo Ding. Ragnor Comerford introduced a branch-based multi-table transaction approach, which Jack is currently working on, and offered to contribute to the code. The team agreed to continue these discussions asynchronously.

Hi, Here’s the recording, notes and actions from the meeting: Lance Community Sync If you’re interested in trying out Otter.ai for yourself, sign up for free here.

– Drew

Otter.ai, 800 W El Camino Real, Suite 170 Mountain View, CA 94040 Email settings   Unsubscribe

[min yan via Otter.ai]

min yan has shared notes from Lance Community Sync, Jun 18 . The Lance Community Sync discussed several key points. First, the team highlighted recent performance blogs on Lance DB, comparing Lance, Delta Lake, and Iceberg on object stores. Will Jones proposed three sub-proposals for format changes: using a separate repository, GitHub approvals for voting, and moving discussions to PRs. The team agreed on the second and third proposals, emphasizing the need for better review processes. Xuanwo Ding introduced a new shuffle format optimized for GPU performance, which was met with interest. Ragnor Comerford discussed a multi-table transaction approach, leveraging existing primitives, and expressed willingness to contribute to the codebase.

Hi, Here’s the recording, notes and actions from the meeting: Lance Community Sync If you’re interested in trying out Otter.ai for yourself, sign up for free here.

– min

Otter.ai, 800 W El Camino Real, Suite 170 Mountain View, CA 94040 Email settings   Unsubscribe

[Andrew Gaskov via Otter.ai]

Andrew Gaskov has shared notes from Lance Community Sync, Jun 18 . The Lance Community Sync discussed several key points. First, performance blogs on Lance DB's format layer improvements were highlighted, including metadata benchmarks comparing Lance, Deta Lake, and Iceberg. Will Jones proposed three sub-proposals for format changes: using a separate repository, GitHub approvals for voting, and moving discussions to PRs. Xuanwo Ding suggested keeping format discussions in GitHub or external tools like Google Docs. The team also discussed optimizing Lance performance on GPU, proposing a new shuffle format to improve efficiency. Finally, Ragnor Comerford and Andrew discussed a multi-table transaction approach, aiming to enhance Lance's capabilities without format changes.

Hi, Here’s the recording, notes and actions from the meeting: Lance Community Sync If you’re interested in trying out Otter.ai for yourself, sign up for free here.

– Andrew

Otter.ai, 800 W El Camino Real, Suite 170 Mountain View, CA 94040 Email settings   Unsubscribe