Using an open LLM model for ChatAI

[tatyana...@gmail.com]

Dear Laurence,

 

I recently tried to use the current 4.3.1 AntConc version which is working with ChatAI. I wanted to use an open LLM model, but all the models including default required Open API key and the button “Update models” didn’t work.

 

I then installed LM Studio and a Mistral-7B-Instruct-v0.2-GGUF model to use local server.

 

I understand that I need to use a LLM Bridge to connect AntConc to the model. However, I couldn’t connect AntConc to the local server running in LM Studio. Mistral-7B-Instruct-v0.2-GGUF still was not available in the list of the models and when I tried to Update Models, I was getting the message “the model list could not be updated”.

 

Please let me know what I am doing wrong and whether maybe there is another way of using an open LLM model.

 

Thank you ever so much

 

 

Tatyana Karpenko-Seccombe

 

 

[Laurence Anthony]

Hi Tatyana,

Can I assume you are talking about AntConc 4.4.0 (Beta 2)? AntConc 4.3.1 only has access to OpenAI's models.

Once you confirm that version of AntConc you are using, I'll reply back.

Regards,

Laurence.

--
You received this message because you are subscribed to the Google Groups "AntConc-Discussion" group.
To unsubscribe from this group and stop receiving emails from it, send an email to antconc+u...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/antconc/096601dcb4de%241671d310%2443557930%24%40gmail.com.

[tatyana...@gmail.com]

Hi Laurence

 

Thank you for your reply – I was using a 4.3.1!!!

If I am using 4.4.0 Beta which has a selection of default models, I assume, I don’t  need to bother with LM Studio?

 

Thanks again

 

Tatyana

 

Sent from Outlook for Android

---

To view this discussion visit https://groups.google.com/d/msgid/antconc/CAL6Fgv3798arj5KWGUyNhDSH9UYP1eSfgks_rFxMfLsFJ1ezGg%40mail.gmail.com.

[tatyana...@gmail.com]

All sorted now – works perfectly, thank you!!!

 

Tatyana

 

From: ant...@googlegroups.com <ant...@googlegroups.com> On Behalf Of Laurence Anthony
Sent: 17 March 2026 01:04
To: ant...@googlegroups.com
Subject: Re: [AntConc:4291] Using an open LLM model for ChatAI

 

Hi Tatyana,

To view this discussion visit https://groups.google.com/d/msgid/antconc/CAL6Fgv3798arj5KWGUyNhDSH9UYP1eSfgks_rFxMfLsFJ1ezGg%40mail.gmail.com.

[Laurence Anthony]

Hi,

That's great to hear!

Laurence.

To view this discussion visit https://groups.google.com/d/msgid/antconc/005201dcb621%24fb3f7c10%24f1be7430%24%40gmail.com.