We thoroughly enjoyed San Francisco. The port was very close to Pier 39 (walkable)which has all kinds of shops/restaurants/etc. The port was also close enough for anyone wanting to venture out on their own without booking a tour. The cable-car loop is at Fisherman's wharf (walkable)that will take you up to Union Square. There is also bike-rentals nearby allowing you to bike to the Park if you so choose. Overall, this is a lovely city to visit as it is laid out in such a manner that a tourist can get around without too much difficulty (or expense).
Victoria is another port where the ship is not too far from the downtown harbour area. There are shuttle buses available for those not wanting to walk. If you enjoy walking, it would take roughly 1/2 hour to get to the harbour.
Victoria's inner harbour is laid out in such a manner that everything is walkable. They have outside entertainment/good shopping/and views that are breathtaking. For those wanting to see the Buchard Gardens, you can either book a tour or arrange something on your own.
This is a city well worth seeing. Very laid back and safe.
More 