Are we making AI agents too capable before we know what we actually want them to do?

When I see agents that can talk see things connect to apps and actually take actions it sounds useful but also makes me wonder where the line should be. Giving an agent more abilities can solve more problems but it also means there are more things that can go wrong when it misunderstands the situation. How do you decide which actions an AI agent should be allowed to handle on its own?