Besides Whitstable Harbour, visit Mussel Shack in the vicinity. That's a nice idea to order tasty oysters and nicely cooked mussels. Delicious beer is the most popular drinks of this restaurant.
The fabulous service will make you feel nice. But google users rated Mussel Shack and it didn't get a high rating.