Expedition: general discussions.

You could simply decline and continue managing the city without participating in the "main quest." Additionally, you could board a ship and sail to another location at any time, up until the day you were scheduled to visit the palace. In the second case, I would have had to pause the game for a week or two because the content wasn't detailed, but that option was available.