How much is too much, out of curiosity? I usually tighten the retention screw until it stops and can't be tightened anymore. Should I be stopping before that? I don't want to strip my sabers' threads. I'm glad I found this topic. Whew.
Always use the long end of the wrench in the socket, (not as the handle), and tighten it so that it stops moving, but no more. Test it by grabbing the blade and hilt and seeing if there's any give or play. If it's solid, it's good.
If actually fighting with the saber, check it frequently as hard impacts may loosen it after a few hits. If this happens, tightening it once more usually makes it sit for longer than the first time did, if not the rest of the session.