Anyone else change their product more than they expected?

When I started I had a pretty clear idea of what the product should be and what I definitely didn’t want to build.

Then customers started asking for things I never planned to add and some of those requests actually made sense. Slowly the original idea started changing. How do you know when you’re adapting to real feedback versus slowly turning the product into something you never wanted to build?