In all fairness we've been on this island before and the Brimstone Hill is well worth a visit for the historic fort and beautiful vistas, but, it has only mediocre beaches.
There are two neat towns here, Marigot and Phillipsburg, as well as a number of great beaches. This place also has great shopping in Phillipsburg (on the Dutch side).
The Baths is truly a unique and beautiful spot and not to be missed. A lunch at Top of the Rock (at the top of the Baths trail) provides good food and a truly spectacular Caribbean vista.