Just had to check out a conversation I had with Kouri. He's the ultimate Forum go to person for electronics customization along with JediXIX. Unfortunately both only visit the Forum on an irregular basis. Racona Nova is our Electronics Moderator but does not do customizations yet.
Kouri says that one could use a super glue. But the brand E6000 which I believe comes in a silver tube ( large or small individual tubes ) would be the best. Gives a bit of setting room and is shock absorbent. Therefore less chance of the switch moving or detaching from the hole edges.
Hope this helps and let us know the results and the product you actually used.