We almost shipped the wrong design. 🤦♂️
~2x faster conversion while the others designs all floundered. That was the result of simulations doing the talking while building password only access for Vibe Check instead of arguing in circles.
"Failing" designs cost the collective time of every user and then again by a Product team working on needless iterations. We’ve baked this simulation first mindset into our new tool, Vibe Check. We launch on Product Hunt next week! Support us and ensure actual conversion on your next product designs.
42 views
Replies
Simulation-first mindset, love it, @kevin_mcdonagh1! Most teams “feel” their way into a design, then A/B test too late, so baking simulation-led decisions before dev even starts should be the right standard to follow. Looking forward to your next one!
Velocity: AI User testing
@rohanrecommends Yes, there has been an evolving understanding that managing the development of products is done effectively by working backwards from the outcomes we are trying to create. But always has been difficult. We want to encourage this product mindset of measuring what matters with a new generation of Vibing Gen-AI builders.
What is the basis for AI deciding which performs better? Is it trained on some kind of reference data?
Velocity: AI User testing
@nadal_ace Depending on which Persona you pick, depends on the outcome of the reports. Generally though as this is not a replacement for humans we don't dwell on their accuracy. Instead they are most useful as directionally relevant heuristics during prototyping. The default 'Agentic' persona is more of a super user, if it doesn't get through the experience it's likely a human will struggle. The only other persona in the default tiers is the blurred vision persona which simulates some of the challenges of identifying chunked areas of information. In comparison, for multivariate testing, the Agentic persona is it's own measure... but if it performs better in one or another it will reliably be reflected in human outcomes.