If you are prepared to run the gauntlet of taxi/tour operators at the port entrance you can find taxi drivers willing to take you anywhere, but do haggle and fix a price before you leave.
There are many lovely beaches and you get the feel of the island driving around.
We did our only PO Excursion here, Kayaking and Snorkelling which we found to be excellent value. The young local man in charge was confident, efficient and made sure all participants enjoyed themselves.
We were taken to Le Reduit beach which is recommended by PO but found it to be incredibly crowded, sunbeds crammed together, in poor condition and extremely sloping with a strong under-tow. It wasn't a pleasant swimming experience.
I believe many people pay a taxi driver to take them to (maybe)see a plane land or take off at the unbelievable little airport and maybe be blown off their feet or be sand-blasted! A very inventive friend wore his mask and snorkel for this experience!