The first tower of this castle is said to have been built during the 9th or the 10th century by a member of the nobility who sought protection from the Norman attacks. The Lords of Harze later added to that initial tower, making it a full-fledged castle. In the 17th century, the castle was restructured to how it remains today.