You’ve explored the power of GPT-3 & ChatGPT; now you can apply that power to your own data by bringing GPT-3 to your database with MindsDB, to deliver additional insights & value to your existing data.
MindsDB is an Open-Source ML Platform for Developers
Looks really cool. Curious what kinds of validation you have on the output?
One of the things keeping me from using GPT in production is its tendency to "hallucinate".
@stedmanblake One thing that can certainly help is the 'temperature' parameter. This is enabled with MindsDB - you can set it low to make sure the answer is at least more deterministic
https://platform.openai.com/docs...
Report
@stedmanblake Indeed. Solving these hallucinations is an active research area. In theory, architectures like DeepMind's RETRO should be better at this. MindsDB's approach could prove very useful here by providing a simple and fast integration with knowledge bases via our DB handlers.
Report
@stedmanblake this is a very good point, I think it would be very cool to measure, certainly we should be able to ask the model if the info is made up or not, i will make some research on this, would you like to collaborate?
Report
@stedmanblake MindsDB takes the accuracy and reliability of its predictions very seriously and implements a number of validation techniques to ensure that the output is trustworthy. Some of the validation techniques used by MindsDB include:
1. Data quality checks: MindsDB performs data quality checks on the input data to ensure that it is clean and suitable for model training. This helps to prevent issues with the output that can arise from poor-quality data.
2. Model performance evaluation: MindsDB evaluates the performance of its models on a validation dataset to ensure that they are performing well and not overfitting to the training data. This helps to prevent issues with the output that can arise from models that are too complex or not well-suited to the data.
3. Model interpretability: MindsDB provides interpretability features, such as feature importance, that allow you to understand how the model is making its predictions. This helps to ensure that the output is reasonable and that the model is not relying on obscure or unusual relationships in the data.
4. Post-prediction analysis: MindsDB provides tools for post-prediction analysis that allow you to examine the output of your models and make sure that it is accurate and makes sense. This helps to identify any issues with the output and ensure that the model is performing as expected.
Overall, MindsDB takes a comprehensive approach to ensure the accuracy and reliability of its predictions and provides multiple tools and features to help you validate the output and ensure that it meets your needs.
Some months' technical challenges, like sentiment analysis, in the past, are solved now in a couple of minutes with your solution, and I like that! It can save time for chat/text moderation or finding issues.
I noted to give it a try, it's promising!
Congrats @adam_carrigan !
Replies
Lotus
Snoopstein
ThoughtfulPost
Jib
Snoopstein
Flamme – The AI Couples App
Snoopstein
Snoopstein
KiwiBot
Snoopstein
Shopercase
Snoopstein
Shopercase
Carbone
Snoopstein