Best Way to Remove Exterior Caulk

To remove caulk around the exterior shower box I used a plastic putty knife to carefully pry off the old. I then cleaned it up with denatured alcohol. I used a Geocel product but don't recall which. 

Even a better cleaner is 3M Adhesive Remover.

For removal of remnants of old exterior caulk on exterior siding left after scraping most off, would mineral spirits be fine?

WD-40 is also a surprisingly good adhesive remover.  Also consider 3M Adhesive Remover, which I find to be very effective and safe on all surfaces I've tried.

@manyman297.  Just a hint: Have all surface prepared, clean and ready before you open the tube.  I found that the Geocel products set up quickly....even in the tube once it has been opened.  Towards the end of my caulking it was getting harder and harder to smooth out the bead with my finger.  

A quick comment about removing old, exterior caulk.
I found that Goo Gone Spray Gel Adhesive Remover really works well to remove the old caulk.  I rub it into the joint with an old cloth to prevent dripping.  After a few minutes the old caulk softens quite a bit.  Then I use the plastic 'chisels' shown below to scrape the gooey mess off.  The plastic doesn't scratch the finish and it can be easily sharpened with a fine grit sandpaper. Lastly, I clean the joint well with rubbing alcohol before applying new caulk.  I hope this helps!