In the heart of East England lies a less-discovered historic city boasting Norman fortresses and medieval bridges, but without the crowds of rival destinations.