AnythingLLM

The all-in-one desktop AI application

175 followers

The all-in-one desktop AI application

175 followers

Visit website

Knowledge base software

•

LLMs

•

AI Chatbots

AnythingLLM is the ultimate all-in-one desktop AI app & assistant you have been looking for. AnythingLLM includes a built-in LLM, RAG, AI Agents, and even custom tooling to improve your productivity all while running fully locally & privately on your desktop.

Free

Launch tags:Productivity•Artificial Intelligence•GitHub

Launch Team / Built With

PinMe — Publish Sites in Seconds. Tamper-proof by design.

Publish Sites in Seconds. Tamper-proof by design.

Promoted

AnythingLLM

Maker

📌

You want a desktop AI that just does it all - that is AnythingLLM. Hey ProductHunt 👋! Long-time member, longer-time builder. I wanted to finally formally launch AnythingLLM to the community. AnythingLLM is the all-in-one AI app that just works and does exactly what you hope other apps would do, locally and privately on your desktop. AnythingLLM bakes in all of the things you are looking for, but with no setup, and no command line tools, all in one application you can just install on your computer. AnythingLLM includes... 🤖 A built-in LLM engine That's right, no Ollama, LMStudio, or API key. You can just download the latest cutting-edge models and run them without any other software. You can still use your favorite tool or cloud-based LLM if you have a preference 😁. 📚 Upload and chat with documents With our built-in embedder and vector database you get full RAG capabilities to chat with your documents like you can in other popular apps. Just drag and drop files or images and you can chat with them nearly instantly. 🧠 AI Agents that are useful We include some sensible AI agents to help you be productive. This includes tools like Web Search, Web Scraping, SQL Connector, Document Summary, File creation, and soon - custom tools you write or get from our community of over 4K+ members. 🔌 Data connectors Aside from local documents, you can also connect to various external data sources like GitHub, Confluence, and other websites to build up your LLMs knowledge base. 🔒 Privacy first Unless you decide to work with a third party, AnythingLLM is fully on-device and private. Everything is stored on your device to ensure maximum security. This is why large corporations opt to use AnythingLLM within their organizations and why you might want to also. Your IT team will love how easy it is to install ❤️ 🤩 Open-Source Lastly, but for the hackers, AnythingLLM is open-source, and with over 18K GitHub stars and 2 years of a solid development track record - AnythingLLM is here to stay. And some notable other features: - Text-to-speech and speech-to-text support - Full developer API for custom integrations - Poppin Discord community of 4K members - Dark mode first (and only lol) - Works with the LLM provider you are already using AnythingLLM is the result of our team's dedicated focus for 2 years to bring AI fully locally with a no-fuss setup that just works the way you want. AnythingLLM hopes to be your ideal solution for improving productivity with zero frustrating setups or configurations. Bonus! We offer a Docker Image with over 100K+ pulls that offers a more "multi-user" and administrative version of AnythingLLM that has all the benefits of the desktop app with rule-based access for those who want a more centralized way to onboarding you org with a cutting-edge AI tool suite. Let us know what you think! - Timothy Carambat

Report

1yr ago

Telebugs

Hey Tim, I'm wondering how you handle model updates. Do users need to manually download new versions or is there an automatic update process? How does the performance of your built-in LLM compare to popular alternatives? Congrats on the launch!

Report

1yr ago

AnythingLLM

Maker

@kyrylosilin The built-in LLM is Ollama, and we keep it up to date. Any improvements made there, we can easily adapt with an app update. As for using new models or adopting new checkpoints - they need to be done manually by the user or a model uninstall/reinstall.

Report

1yr ago

I use it solely because LanceDB is built into the product. It's totally awesome, and I'm loving it! I can't wait to see what the future holds for this app.

Report

1yr ago

AnythingLLM

Maker

@rahman_razak +1 on LanceDB!

Report

1yr ago

Variety sounds great with AnythingLLM! I checked it out, and it seems to have everything. Great work open-sourcing and prioritising privacy.Glad you launched.

Report

1yr ago

Product Hunt

I previously only used cloud LLM services, but AnythingLLM helped me make the jump to trying out all the different flavors of LLMs. Keep up the great work!

Report

1yr ago

Super designer

I use it everyday. You have created an amazing tool.

Report

1yr ago

This new AI tool sounds cool and all but isn't it a bit excessive to have everything crammed into one app, like sometimes I just need simple and specific tools not an entire suite, feels like overkill to me

Report

1yr ago

AnythingLLM

Maker

@bizgrowthleader You would only have the overhead for the things you need, it's not overkill to me because siloing each feature or capability does not make sense for the everyday person. Agents on one platform, RAG on another, LLM somewhere else, Prompts stored on another. Its a lot to configure over and over. Sure, independently your specific use may require that kind of isolation, but most wind up integrating them all anyway since Agents, RAG, or a prompt library standalone has a limited ability to help sometimes as their use case evolves. Eventually, it tends towards convergence and might as well be in one place. Obviously, not 100% of use-cases as more specific implementations make more sense to do one singular thing totally standalone.

Report

1yr ago

1 2