Remove Cap

Pry the cap off with the flat-head screwdriver.
There will be some resistance as you pull the remaining sealant away.

I suspect a heat gun might help a little, but I think it might make stuff too "gooey" and messy.
The cap came away after a little prying, so a heat gun is not necessary.