If the switch is still glued in by Ultrasabers, the best way would be heating the hilt (gently and not directly onto the switch and/or Recharge Port!) until it's getting soft. Then pry it out (again, gently and mask the hilt so that you don't scratch it). If needed, you can cut its wires (mark them before and after the cutting point, that helps with re-soldering) which makes it easier to work with the board and the remaining wires.
Repair the wiring, then re-solder the switch. Heat the glue again, press the switch back into the hole and wait until the glue has cooled down and solified.
Hope I didn't miss anything