trending

🧪 Field Report: Comparing ChatGpt5.4 Vs Mistral Large Vs Gemini 3.1 Pro on a n E-Commerce

I wanted to share a quick benchmark we ran while building Fabio AI Chatbot, testing how different LLMs behave in a real product search scenario.

Instead of synthetic benchmarks, this was done on an actual WooCommerce store (~1000 products), using the exact same prompt across models.

🧪 Test: Comparing the ChatGpt 5.4 vs ChatGpt 5.4 mini Vs ChaGpt 5.4 nano

To better understand how different AI models behave inside Fabio AI Chatbot, we ran a simple test on our kitchen troubleshooting demo site : https://fabio-plugins.com/demo_h... with the 3 latest ChatGPT models from @OpenAI.

The user question

The visitor typed a short and imperfect request :

What's in Fabio AI Chatbot 3.5.2 ?

Fabio AI Chatbot 3.5.2 is live!

We ve just released version 3.5.2 of Fabio AI Chatbot, with two important improvements for WordPress site owners.

Choose your ChatGPT model
You can now select between the three latest ChatGPT models directly in the plugin:
GPT 5.4 best overall reasoning and response quality
GPT 5.4 Mini balanced speed and cost
GPT 5.4 Nano ultra-fast and lightweight

We tested multiple AI models inside our WooCommerce chatbot — here’s what we learned

Hey Product Hunt

We recently ran a simple test inside Fabio AI Chatbot (our WooCommerce plugin connected to stores with a 1000 products catalogs).

We asked different AI models the exact same product query:

We just released Fabio AI Chatbot 3.3.8 for Wordpress / Wocommerce👋

We just shipped Fabio AI Chatbot for WordPress 3.3.8

New in this release:

  • Better WooCommerce product scans

  • Better chatbot answer scrolling

  • Wider popup on large screens

What's in the 3.2.8 version

With the latest 3.2.8 version, you can conect to OpenAI, Gemini or Mistral : https://fabio-plugins.com/instal...

What's in the 3.2.8 version ?

In the latest 3.2.8 version, you can connect Fabio AI Chatbot to OpenAI, Gemini or Mistral.

What's in the version 3.1.4 ?

We have been busy this week with another new version 3.1.4. So what did we improve?

We added a timer that counts how many seconds it takes for the chatbot to respond. This allows you to identify which answers take the longest by checking the conversation CSV.

Whta's in the Fabio AI CHatbot 3.1.1 version ?

We have added 2 main features to display the chatbot :

1- Display manually, automatically or as a pop up bubble

What's in Fabio AI ChatBot version 3.0.0 ?

The Fabio AI Chatbot version 3.0.0 has been fully updated to fit ChatGpt 5 mini. The available features are :

  1. Daily automatic content scan

  2. Manual content scan

  3. Dialogue with ChatGPT 5 mini

  4. Export converations