Local LLM support

[James Reynolds]

It would be great if iTerm2 could specify a local llm like Ollama, which has an OpenAI compatible API. https://github.com/ollama/ollama/blob/main/docs/api.md and https://ollama.com/blog/openai-compatibility.

[Khalil Gharbaoui]

This is indeed very good to have as we don't want to send all our data to OpenAI
But besides that it would be just great to pick our own LLM flavor

[George Nachman]

Please try the latest beta version. It moves the URL setting into the main settings panel (was in Advanced before). This should make it easier to configure a local LLM, but let me know if more is needed.

--
You received this message because you are subscribed to the Google Groups "iterm2-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to iterm2-discus...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/iterm2-discuss/898529fe-79b5-4902-86f4-5692db284984n%40googlegroups.com.