This port on the Kowloon side is very convenient and adjacent to shopping, lodging, and transportation. Prior to the cruise, we stayed at the Royal Pacific which was very convenient to shopping, the cruise terminal (Ocean Terminal) and ferry terminal (same building). To get there from the airport, take the express train (in the Airport building - there is a counter where they accept credit cards - $70 HKD per person with Kowloon being the second stop (VERY fast). Because we were so late (after 11pm), the free shuttles from the Kowloon Station to the hotels were no longer running), we took a taxi (very organized - an attendant directs you to the right taxi) to the Royal Pacific. There is a direct shuttle ($130HKD) which might be slower because it uses city streets and stops at different hotels.
We did not have Hong Kong money, but the concierge quickly advanced the fare directly to the taxi driver and we reimbursed him after check-in when we exchanged some money. We stayed in the tower section on the top floor which was a very nice room. Note that reviews for the main section are poor, but we were not in that area. To get to the cruise embarkation desk, we had to leave the hotel down an escalator, cross a driveway, enter Harbourside Shopping Center, taking an escalator up, then walk through the shopping center (2 areas of stairs between shopping sections) to reach Ocean Terminal.
After the cruise, we walked to another hotel outside which was just beyond the museum complex (a very HOT and sweaty walk)
High end stores and many restaurants (crowded) are in the Harbourside Shopping Center and Ocean Terminal, while smaller shops and additional shopping malls are all within walking distance, with underground walking tunnels (subways) to cross major streets. There is a large grocery in Harbourside and a Sogo underground next to the museums, and several 7-11's in the area to get snacks and other munchies (they also have food courts as well). With several McDonalds, food for kids is easy to get as are Starbucks for the coffee crowd. The Peninsula Hotel with afternoon tea (disappointing - mostly ham sandwiches) is walking distance as well.
We were hit up once by a beggar on the Walk of the Stars (good ruse with telling good fortune - encountered in Beijing once), but he disappeared quickly once he found out all I was carrying was my hotel key.
Internet is free at several coffee shops, and the city provides free internet from the museum complex as well.