Anyone else realize that some problems only disappear after you stop trying to solve them?

When I started I thought every problem needed an immediate fix. If users complained about something I’d jump on it. If growth slowed down I’d try something new. If a process felt messy I’d try to rebuild it. But sometimes the better move was to leave it alone for a while. A few problems fixed themselves as the product changed while others turned out to be problems I was creating by overthinking them. How do you decide when a problem actually needs your attention and when it’s better to just leave it alone?