Interest in Idea 15: LightGlue Matcher with Aliked Feature

77 views

Skip to first unread message

Allison

unread,

Mar 17, 2025, 9:37:38 PMMar 17

to opencv-gsoc-202x

Hi OpenCV Contributors,

My name is Allison Hu, and I am a software developer with a strong interest in computer vision. I have experience fine-tuning computer vision models in PyTorch, particularly for object detection. I am interested in contributing to IDEA 16 LightGlue and ALIKED into OpenCV.

After reviewing the paper and related resources, I understand that ALIKED is a feature extractor, LightGlue is an attention-based matching model that matches keypoints features extracted by ALIKED between two images, and KeyPointsSubPx is a model for performing sub-pixel adjustments on keypoints.

Based on this, I believe the integration should be a relatively straightforward. OpenCV’s DNN module already supports importing pre-trained PyTorch models. Additionally, the existing FeatureDescriptor and Matcher classes in OpenCV should provide useful references for implementing this functionality.

One concern I have is ensuring that the test coverage includes all potential cases and different dependencies. Since this feature will be foundational for downstream tasks like 3D reconstruction, and tracking, thorough testing is essential. Currently, I am working on fixing a small bug in OpenCV to familiarize myself with the open-source contribution process. Given my experience, I believe I am well-suited to contribute to this challenge and am excited about the opportunity.

I would appreciate the chance to connect with a mentor to discuss this feature integration further.