Open-AI compatible servers?

This topic is: resolved

 

Thank you for contacting me. Please note that I live in the GMT+3 time zone - responses might be delayed by this.

This topic has 1 reply, 2 voices, and was last updated 6 months, 1 week ago by Szabi – CodeRevolution.

Viewing 1 reply thread
  • Author
    Posts
    • #10744


      pagenet
      Participant
      Post count: 4

      Can I use AI-omatic with Open-AI compatible servers?    I’ve been running my own Open-AI compatible server using LLMs from Huggingface.   It uses the same endpoints and syntax as OpenAI.  Is it possible to change the Open AI server address location in AI-omatic?

      Why would I do this?   I save $20/mo to start with .. plus I can fully pre-train my own LLMs for our projects.

    • #10745


      Szabi – CodeRevolution
      Keymaster
      Post count: 4621

      Hello,

      I plan to add support for an upcoming update of Aiomatic, to allow it to use local Ollama models, which will be able to be similarly used for free, if installed on your local environment. Let me know if this is also a good alternative for you.

      Regards, Szabi – CodeRevolution.

Viewing 1 reply thread

The topic ‘Open-AI compatible servers?’ is closed to new replies.