Antigua has a *lot* of beaches, so here's how to get to Jolly Beach on your own - go out to Market St., turn right and there will be a bus terminal in a few blocks (note: "bus" in Antigua is usually a mini-van - the same vehicles serve as taxis). Take bus #20 to the end of the line at the entrance to the Jolly Beach resort. About 10min walk straight ahead (direction that bus arrived) is the beach, with the usual amenities to rent, and at least one beach bar. This is an upscale resort area (I had no problem walking into the resort), so better dining options are available in the resort. Bus fare (as of Feb 2009) is EC$3.25 each way (about US$1.25).
The island is still recovering from a direct hit by Hurricane Ike last fall. The small historical museum in town survived and is worth a visit if one is looking for something to do.
We took the Yellow Submarine semi-submersible tour. This goes out to a wreck and the reef; there were plenty of interesting fish and a few sea turtles to see. Visibility depends on the weather - it was a bit murky, but still ok due to serious weather the day before. This was an interesting trip, especially as we don't dive or snorkel.
The beach on the far side of the Baths, Devil's Bay, is a much nicer and less crowded beach than the one at the Baths proper, but there are no facilities (e.g., bathrooms) there whatsoever. To get there, instead of walking down the trail to the Baths, turn left at the ticket office (you do need a park admission ticket) and walk uphill to find the trail from the parking lot to Devil's Bay. It's a longer walk, but well worth it. Taxis are readily available from the yacht harbor (where the tenders dock) to the Baths and back.