Inquiry About LLM Support for the Kurdish Language

[Amr El Gendy]

SA,

Ramadan Kareem,

I would like to inquire whether any large language models (LLMs) support the Kurdish language with reasonable quality, particularly in terms of understanding and text generation.

Thank you in advance for your assistance.

Best regards,

Amr El-Gendy

[Mohamed H.]

wa alaikum salam,

Ramadan Kareem.

Does Kurdish have a textual and/or audio corpus that is accessible online? 

Having access to quality corpora is a good first step to do testing.

Shukran,

--
You received this message because you are subscribed to the Google Groups "SIGARAB: Special Interest Group on Arabic Natural Language Processing" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sigarab+u...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/sigarab/CAC1zSJjo8uH8Pj5OX6VVmYvoshg%3DdbJkgO6BQFDiX5RoPtK3KQ%40mail.gmail.com.

-- 
Find me at:
https://www.kentoseth.com
https://fosstodon.org/web/@kentoseth

[Rania Azad]

Dear Mohammed,

You can find many resources gathered by Dr. Sina here: sinaahmadi/awesome-kurdish: A curated list of awesome resources and tools for Kurdish language and speech technologies

Best

To view this discussion visit https://groups.google.com/d/msgid/sigarab/647b2054-b9a7-4219-be4e-935e98ce9411%40devcroo.com.

--

Rania Azad M. San Ahmed                Lecturer, PhD Student                Editor Manager of KJAR Journal               Computer Network Department               Technical College of Informatics                 Sulaimani Polytechnic University                     +964 (0) 7700362478 | rania...@spu.edu.iq

[Omar Kamali]

Dear Mohamed and Rania,

Please allow me to share these additional resources for Kurdish and Central Kurdish with you. 

Datasets:

- Kurdish: https://huggingface.co/datasets/omarkamali/wikipedia-monthly/viewer/latest.ku

- Central Kurdish: https://huggingface.co/datasets/omarkamali/wikipedia-monthly/viewer/latest.ckb

Ngrams, embedding models and others for both languages:

- https://huggingface.co/wikilangs/ku

- https://huggingface.co/wikilangs/ckb

While not an LLM, you can interact with some of the models directly on the playground and generate Kurdish text with the "Text Weaver" function for example.

https://wikilangs.org/playground/?lang=ku

I am the maintainer of these resources, let me know if you find any mischaracterization of your language. Thank you,

Best,

Omar Kamali · Founder @ Omneity Labs 

AI & NLP for languages that matter