I voted for York Town, seeing as without it's tower it's purpose is severely deminished. Plus with the lack of horse races hosted these days(I don't blame you, it's not a good event, to be honest). I would like to see the horse racing area replaced by a port, since York town is a coastal city.
I imagine a couple different things this port could contain.
1. NPC's who would come by boat(aka, refreshing occasionally) who would be selling seafood. They could see hats, but then it would just be another bazaar(though you could have them sell furniture).
2. Random NPC's would say to you "Thank you for combating the pyrats!" If the game recognized you had completed your pyrat quest.
I'm sure there are more ideas that you could come up with, but that's what I would like to see given the choice.