Become a fan of Slashdot on Facebook

 



Forgot your password?
typodupeerror
×
AI Open Source

Open Source ChatGPT Clone 'LibreChat' Lets You Use Multiple AI Services (thenewstack.io) 39

Slashdot reader DevNull127 writes: A free and open source ChatGPT clone — named LibreChat — lets its users choose which AI model to use, "to harness the capabilities of cutting-edge language models from multiple providers in a unified interface". This means LibreChat includes OpenAI's models, but also others — both open-source and closed-source — and its website promises "seamless integration" with AI services from OpenAI, Azure, Anthropic, and Google — as well as GPT-4, Gemini Vision, and many others. ("Every AI in one place," explains LibreChat's home page.) Plugins even let you make requests to DALL-E or Stable Diffusion for image generations. (LibreChat also offers a database that tracks "conversation state" — making it possible to switch to a different AI model in mid-conversation...)

Released under the MIT License, LibreChat has become "an open source success story," according to this article, representing "the passionate community that's actively creating an ecosystem of open source AI tools." And its creator, Danny Avila, says in some cases it finally lets users own their own data, "which is a dying human right, a luxury in the internet age and even more so with the age of LLM's." Avila says he was inspired by the day ChatGPT leaked the chat history of some of its users back in March of 2023 — and LibreChat is "inherently completely private". From the article:

With locally-hosted LLMs, Avila sees users finally getting "an opportunity to withhold training data from Big Tech, which many trade at the cost of convenience." In this world, LibreChat "is naturally attractive as it can run exclusively on open-source technologies, database and all, completely 'air-gapped.'" Even with remote AI services insisting they won't use transient data for training, "local models are already quite capable" Avila notes, "and will become more capable in general over time."

And they're also compatible with LibreChat...

This discussion has been archived. No new comments can be posted.

Open Source ChatGPT Clone 'LibreChat' Lets You Use Multiple AI Services

Comments Filter:
  • I don't get it... (Score:3, Insightful)

    by fuzzyfuzzyfungus ( 1223518 ) on Saturday June 22, 2024 @10:05AM (#64569081) Journal
    Isn't using this particular frontend to a bunch of proprietary models other people are running, and can do whatever they like with the prompts going into, sort of like saying that I'm "owning my data" because I user thunderbird to connect to my gmail account and my hotmail account?

    Sure, using something that isn't the vendor's curious interpretation of what makes a good web UI might well be nice; but it absolutely does not change the structure of what you are doing.
  • They could have come up with a name that doesn't conflict with the new-ish F/OSS project focused IRC network that everyone migrated to from that old one that I forget the name to...

    • by ls671 ( 1122017 )

      What are you talking about? LibEraChat != LibreChat, I didn't even think of Libera Chat IRC when I read TFS.

  • by Talon0ne ( 10115958 ) on Saturday June 22, 2024 @12:26PM (#64569289)

    It's so easy even I set it up (and bolted in RAG in the Node.js code to hit my own vector database). Completely self hosted LLMs with a ChatGPT UI, all running on a few easy-as-pie to set up Docker containers with the source code easy to fiddle with... These guys are heroes in my book. It literally could not be easier to work with.

    • Re: (Score:2, Insightful)

      by ffkom ( 3519199 )
      Please provide a link to the actual "self hosted LLM" that you host "on a few easy-as-pie to set up Docker containers", without actually sending your prompts to any of the closed, proprietary services listed at [librechat.ai].
    • by awitod ( 453754 ) on Saturday June 22, 2024 @08:27PM (#64570001)

      Thank you. The amount of stupid in these comments is appalling

      • by ffkom ( 3519199 )
        In that we agree. It is incredible how people confuse "running a shallow intermediate API locally" with "running an an actual LLM locally", and keep defending a headline describing a shallow intermediate API as a "ChatGPT Clone".
  • yet ...
  • There are already many answers from locally hosting any of the available LLM models and this is not private if connecting to third party servers, though open ai may offer more privacy to commercial api gpt users vs chatgpt that is voluntary on their part, they still get all your data.

    I'm seeing no reason I'd choose this over something like Voxta with integration to just about every service, their own privacy focused cloud service, and tts/stt integration for natural interaction as a core feature. Actually I

The fancy is indeed no other than a mode of memory emancipated from the order of space and time. -- Samuel Taylor Coleridge

Working...