LVIS labels WordNet correspondence

[Глеб Кумичев]

Hi!

Thank you for such a grate dataset!

I have a question about LVIS labels.
My goal is to define LVIS label to WordNet synset mapping and there are few problems.

As far as I understood all LVIS labels should be a subset of WordNet synsets.
I explore intersection between LVIS labels and WordNet noun synsets, and there are 15 labels that has no exact match at a first glance. But all of them can be found in a WordNet using different names, for example:

• baseball_base -> home_plate.n.01

• boom_microphone -> boom.n.03

• brass_plaque -> brass.n.07

etc.
Such a correspondences I perform manually wrt synset description and image examples, as a result I confident that labels has exactly the same meaning as a synsets.

For the rest of the labels it is overwhelming to find correspondence manually, but if I do it just by word matching it can lead to a mistakes, for example:

For a label vent from LVIS there are 5 different noun synsets from WordNet, such as a vent.n.01 (hole for the escape of gas or air), vent.n.03 (a fissure in the earth's crust), vent.n.04 (a slit in a garment), etc. And wrt LVIS images only first is the right one.

So my question is: how can I find such LVIS labels to WordNet synset correspondences automatically, whether it is possible?

[Ross Girshick]

Thanks for the question. I've answered it on github here: https://github.com/lvis-dataset/lvis-api/issues/35#issuecomment-1268569566.