Best Products
Launches
Launch archive
Most-loved launches by the community
Launch Guide
Checklists and pro tips for launching
News
Newsletter
The best of Product Hunt, every day
Stories
Tech news, interviews, and tips from makers
Changelog
New Product Hunt features and releases
Forums
Forums
Ask questions, find support, and connect
Kitty Points Leaderboard
The highest scoring community members
Streaks
The most active community members
Events
Meet others online and in-person
Advertise
Subscribe
Sign in
Kolosal AI
Train and Run LLMs On Your Device Fully Opensource
127 followers
Train and Run LLMs On Your Device Fully Opensource
127 followers
Visit website
Open-source platform to train, download, and run LLMs on device. Kolosal is designed to be fast, lightweight, and sustainable. It’s only 20 MB in size, yet it can run LLMs just as quickly or even faster than other competitors.
Overview
Reviews
Alternatives
Team
More
Subscribe
Sign in
Kolosal AI Alternatives
Alternatives Discussion
p/general
by
Maria McGinn
•
2mo ago
Anyone else building AI features without relying on external LLM APIs?
10
Show more forum threads
Alternative Products
Most relevant
developer tools
(40)
api
(18)
ai infrastructure
(35)
bots
(11)
productivity
(11)
audio
(10)
software engineering
(9)
github
(37)
tech
(15)
saas
(6)
computers
(3)
multilingual support
(4)
self-hosting option
(7)
android
(6)
long context window
(2)
Framer AI Agents
Design and publish professional sites with AI
Try Framer AI Agents
Promoted
Gemini
Google's answer to GPT-4
4.9
(
167 reviews
)
LLMs
•
AI Chatbots
•
Predictive AI
android
productivity
api
software engineering
github
Unfollow
Following
Follow
Hugging Face
The AI community building the future.
5.0
(
94 reviews
)
LLMs
•
AI Infrastructure Tools
productivity
api
saas
developer tools
github
Unfollow
Following
Follow
Llama
Meta's open-source family of LLMs
5.0
(
65 reviews
)
LLMs
software engineering
developer tools
github
bots
Unfollow
Following
Follow
Ollama
The easiest way to run large language models locally
5.0
(
43 reviews
)
AI Infrastructure Tools
•
LLM Developer Tools
self-hosting option
github
ai infrastructure
Unfollow
Following
Follow
Whisper by OpenAI
A neural net for speech recognition
5.0
(
43 reviews
)
AI Voice Agents
•
Text-to-Speech Software
multilingual support
github
Unfollow
Following
Follow
Mistral AI
Open and portable generative AI for devs and businesses
5.0
(
41 reviews
)
AI Infrastructure Tools
•
Foundation Models
multilingual support
android
productivity
api
saas
Unfollow
Following
Follow
Groq Chat
An LPU inference engine
5.0
(
52 reviews
)
Predictive AI
•
AI Infrastructure Tools
bots
tech
ai infrastructure
Unfollow
Following
Follow
Qwen3
Think Deeper or Act Faster
5.0
(
23 reviews
)
LLMs
long context window
productivity
api
audio
Unfollow
Following
Follow
Cohere
Build incredible products with world-class language AI
4.9
(
13 reviews
)
LLMs
•
AI Infrastructure Tools
self-hosting option
multilingual support
long context window
api
saas
Unfollow
Following
Follow
Nous Research
World-class open source AI
5.0
(
5 reviews
)
Foundation Models
developer tools
github
computers
Unfollow
Following
Follow
See more alternatives