Well to let people know, I got it out. I destroyed the middle section carefully and dragged it out. No damage to the saber. I threw away the blade plug and I learned my lesson to not buy/get a blade plug again.
I also had the same problem and I used sticky tape to pull it out. Just glue something on the plug and you should remove it safely. :-)