It's an old Anglo-Saxon church. The oldest one in England. It isn't very large but it has a cool history and worth checking out while you're in town.
Leeds Castle isn't too far from Canterbury. I'd recommend that as well.
Also Brighton isn't too far from that area either. It's a cool beach resort town with a lot of things to see