UniMorph data and wiktionary-tools discrepancies?

[Lam An Wyner]

Hello all,

I am part of a group that has been examining the available UniMorph French data for a paper we are writing, as it seems to contain a number of Middle/Old French lemmas and inflected forms. When examining the scripts in the unimorph/wiktionary-tools GitHub, we noticed that the issue of filtering out lemmas from languages which have the target language as its suffix seems to have been addressed in commit 7dfe479; however, the unimorph/fra GitHub still includes "acoustrer" and its inflected forms even though it is not a modern French word. Are there other scripts which were used to produce the files in unimorph/fra? If so, where can we find them?

[Khuyagbaatar Batsuren]

Hi Lam,

Have you checked out fra.segmentations file? https://github.com/unimorph/fra/blob/master/fra.segmentations

It doesn't contain the word "acoustrer." Could you check if this file contains historical French words or not?  

You can also quickly transform it into UniMorph 3.0 format by replacing '|' with ';' and ignoring the 4th column.

Best regards,

Huygaa

On Wed, Feb 28, 2024 at 7:54 AM Lam An Wyner <laman...@umass.edu> wrote:

Hello all,

I am part of a group that has been examining the available UniMorph French data for a paper we are writing, as it seems to contain a number of Middle/Old French lemmas and inflected forms. When examining the scripts in the unimorph/wiktionary-tools GitHub, we noticed that the issue of filtering out lemmas from languages which have the target language as its suffix seems to have been addressed in commit 7dfe479; however, the unimorph/fra GitHub still includes "acoustrer" and its inflected forms even though it is not a modern French word. Are there other scripts which were used to produce the files in unimorph/fra? If so, where can we find them?

--
You received this message because you are subscribed to the Google Groups "unimorph" group.
To unsubscribe from this group and stop receiving emails from it, send an email to unimorph+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/unimorph/3cad84bf-7cb9-46f4-a582-c79f28f42de1n%40googlegroups.com.