Do you ever simplify things after making them too complicated?

When I first started building things I thought adding more features would always make the product better.

Then I realized every extra feature also adds more decisions suppor and things that can break. Sometimes the hardest part is knowing what to remove. How do you decide when a product needs more features versus when it just needs to be simpler?