Building pioneering AI tools for financial, legal, compliance and regulatory intensive industries in private cloud or on prem with Small Language Models
LLMWareMaker
📌Hello Product Hunters! My name is Namee, co-founder of LLMWare.ai, and I would like to share my open-source repo that will help you build really useful AI apps for the enterprise.
I used to work as a Corporate Attorney at BigLaw working crazy hours doing very mundane and sometimes mind-numbingly repetitive tasks. I wanted to build AI that everyone can use to help solve the everyday soul-crushingly boring tasks like information retrieval, contract reviews, SQL queries, report generation and much more! (These are just few examples here and I am sure you can think of many others. 😅)
Enter Small Language Models🤖
To help people at their corporate jobs, however, I saw a big problem with using external models like ChatGPT to access sensitive data and information. Knowing the data privacy and security concerns of my enterprise clients from my legal days, I knew that they would have a big problem with sending out data this way. After all, enterprises live in fear of data breaches and data copies – this is one of the biggest security risks they have.
💡That realization led me to one simple conclusion. AI has to come directly and privately to laptops where most of us access our work.
‼️Of course the models had to be small enough to run locally. And we needed to provide easy access and easy deployment (either private cloud, on prem or on device) so that no data needs to leave the enterprise security zone. That was my A-ha moment that led me to focus on small language models about 18 months ago.
What is LLMWare?
From the beginning, LLMWare has been exclusively focused on using, fine-tuning, and deploying small language models (SLMs) to enable easy to use and easy to deploy AI for the enterprise. We are pioneers in this space and was selected by Github earlier this year as a leading AI project in open source. 🏆
Who is it Perfect for?
Enterprise developers looking to create lightweight apps for local deployment use cases to enhance productivity and to automate workflow.
How to Get Started
We have over 100+ examples in our open source repo that help you get started plus over 75+ models in Hugging Face. We have published Fast Start to RAG and Fast Start to Agents video series on YouTube along with many other videos that show you step-by-step how to get started with using SLMs. https://www.youtube.com/@llmware...
Sign Up for a Beta Test
In addition to LLMWare's open source library, we are developing our first commercial product that makes it easy to use and to deploy state of the art models directly on laptops, especially Intel-based hardware that powers most enterprise laptops (point and click deployment). If this sounds interesting to you, please contact me directly to sign up to be a beta tester!
A Big THANKS
Thank you Product Hunters for your support! And last but not least, a MASSIVE thanks to @chrismessina, our Hunter Extraordinaire, who believed in the mission behind LLMWare and helped us launch here. 🙏🌟
Report
Picture Picker—Collect,Create,Edit Image@llmware @namee_oberst Congratulations on the launch of your pioneering AI development tools tailored for the financial services industry!
Report
LLMWareMaker
@annaho2000 Thank you so much for your kind words and support!
Report
RaycastHunter
Small Language Models are super compelling — both because they can run more easily behind the firewall but also because they can run locally on-device.
I'm glad @namee_oberst reached out to me to help her with this launch both because this approach to AI deserves more attention and because she's building a very compelling platform with LLMWare.
Report
LLMWareMaker
@chrismessina Thank you so much for the awesome guidance - I truly could not have done this launch without your invaluable help!
Report
Congrats @namee_oberst ! It seems really promising, and I'm excited to try it out for myself. Best of luck with it, and looking forward to seeing where it goes!
Report
LLMWareMaker
@nikhil_arora1 Thank you so much for your kind note!!
Report
Honestly I’d really love to work on this with you if you’re interested. This is a very common need for my customer base right now and I was barking up this same tree albeit a bit differently. Let me know if you wanna collab! @namee_oberst
Report
LLMWareMaker
@jmitch I am happy to meet to discuss! I am attaching my calendly link so please feel free to schedule a meeting with me at a time that works for you. :) https://calendly.com/noberst/dis...
Report
DeepBrain AIWow, Congrats launch on the product Hunt. Do you have a guide for beginner developers?
Report
LLMWareMaker
@youtube_ Thank you so much! We have a big example library to help you get started, but many of our first time visitors prefer to start with our YouTube tutorial with our Fast Start Series. We have Fast Start to RAG (https://youtu.be/uW3fElxcri4?si=...) and Fast Start to Agents (https://youtu.be/SP6X_HU074c?si=...) that help beginner developers by walking through the example code step by step so it is easier to learn RAG or working with Agents. We also have notebooks for people to try in our repo. I hope you try it out!
Report
PostizLLMware is really great!
I love the approach to small language models!
Report
LLMWareMaker
@nevo_david THANK YOU so much for your kind support!!
Report
Congrats on the launch 🚀
Great product, local slms are the way to go!
Report
LLMWareMaker
@astrodevil Thank you so much for your kind comment!
Report
123
•••
Next