This is why you never glue right on top of the solder joint, but back a little from it on the wire, and if you're going to glue right on op of the joint it's also why you should test your work before making it more permanent like that.
Could also try using a hair dryer to warm up and soften the glue to pull it off