Jan

Name: Jan
Rating: 4.0 (1 reviews)

On-device ChatGPT alternative that runs 100% offline

4.0•1 review•

501 followers

On-device ChatGPT alternative that runs 100% offline

4.0•1 review•

501 followers

Visit website

LLMs

•

Compliance software

•

AI Infrastructure Tools

Jan is an on-device copilot that runs 100% offline on your computer. It can run AI on any hardware, from PCs to multi-GPU clusters. It also allows users to connect to server AIs like GPT4 and Groq. Jan prioritizes privacy and is highly customizable. You can download Jan for Windows, Mac, or Linux.

Free

Launch tags:Open Source•Privacy•Artificial Intelligence

Launch Team

ReplayAutonomous app testing for teams who ship at AI-speed

Promoted

Interesting, is there a doc/URL to read more about the tech? Congratulations team!

Report

2yr ago

Hunter

@sanhq Here is a link to their documentation on the framework for the app https://jan.ai/docs/

Report

2yr ago

It looks very promising! I reviewed the Git stats and found that this project has over 30 contributors and is highly active. I was very impressed and will test this repository today.

Report

2yr ago

Jan is a software product that appears simple, but its capabilities are limitless. Key Features: 1. Open-source product: This product's open-source code ensures transparency in the development process, as the Jan.ai team works cohesively and passionately, allowing for continuous expansion of its capabilities. 2. Architecture: Jan consists of two components - the UI (Jan with dialogues) and Nitro (a extension for loading local models). This approach is advantageous as it allows more flexibility in tackling tasks. For instance, if I need something that's not available in Jan, as a developer, I can directly use Nitro, keeping me within the same stack rather than switching between several. 3. API: Jan supports an API that is compatible with OpenAI. This is a competitive advantage for those who wish to transition from cloud-based models like ChatGPT to local ones as the adaptation process would not require significant resource investments. Take note that Jan is designed for the usage of AI models in offline mode, which means certain tasks previously resolved by cloud-based AI owners would need to be done. 1. Finding suitable hardware. In reality, a modern laptop from Apple or a PC with a fast CPU and (or) fast graphics card will suffice. A lot depends on the AI models - you can run an extremely "simple" model on a mobile processor or something more advanced, comparable to ChatGPT 3.5, on a group of powerful graphics cards. The development of Jan at the time of my review is actively ongoing, so it's currently impossible to list all compatible hardware. I am certain that support will eventually cover a wider range of devices. 2. Choosing an AI model. This is quite debatable because the number of available models is significant, and new ones appear regularly. Some resemble ChatGPT 3.5 in tests while others are good at solving only specific tasks. This isn't something Jan is obligated to help with. What's important is that it allows the user to launch arbitrary AI models, and this is its true value. As a user, I prefer to use Jan specifically because it allows me to be independent from cloud AI models. I can be assured that the confidentiality of processed information will not be compromised. It's gratifying to realize that what you send in the dialog box will not be used for analyzing model behavior, will not be used to train other AI models, and will not be used for marketing purposes.

Report

2yr ago