How to add new linguistic resources ?

[Michel Balmert]

Dear members of Unitex community,

I work specifically on vietnamese and I would like to know how to add a new language to Unitex.

I read the manual but - if I'm correct - the part of the manual on adding new language only concerns languages for which linguistic resources already exist so that users can get them appear on the Unitex interface.

My goal is to add to Unitex grammars and dictionaries that I have already built for vietnamese. That means  a totally new language as far as I know.

Could you please tell me how to proceed ou send me any documentation for that ?

Thank you for any help you may give to me.

All the best,

M.B.

[eric.laporte]

Dear Michel,

If you have already tested your grammars and dictionaries with Unitex/GramLab and want to share it, you can upload them on the GitHub platform https://github.com/UnitexGramLab/unitex-lingua .

If you want to test your grammars and dictionaries with Unitex/GramLab, you can:

- create a Vietnamese directory in your personal workspace directory, create the Vietnamese/Dela, Vietnamese/Corpus and Vietnamese/Graphs directories;

- copy your dictionaries into Vietnamese/Dela, check the dictionaries are in the Delaf/Delacf format, compress them;

- copy a corpus into Vietnamese/Corpus;

- make a sentence-spltting graph named Sentence.grf in Vietnamese/Graphs/Preprocessing/Sentence/ ;

- preprocess the corpus;

- test your other graphs.

Best regards,

Eric Laporte

[Cristian Martinez]

Hi!

Some information about how to add a new language support in Unitex is now avalaible on https://github.com/UnitexGramLab/unitex-lingua/blob/master/README.md#how-to-add-a-new-language-support-in-unitex.

Please feel free to ask any further question about the described process here.

Cheers,

[Michel Balmert]

Dear all,

Thanks a lot for your comments and your help.

I will check the ressource given by Cristian. Once I will be OK with it, I will follow your advice, Eric.

Best regards,

Michel