Does adding your whole codebase as context actually make your coding agent worse?

Everyone says "give the agent full context so it understands the architecture." But lately, I've noticed that the more files I index or attach, the more distracted the model gets. It starts hallucinating patterns from old legacy modules instead of following the clean patterns in the active file. Where is the sweet spot for context limits?