Castle Hedingham and the nearby village of Sible Hedingham are not distinguished in the Domesday Survey, but as both were held by Aubrey de Vere in demesne in 1086 this is not important to us. The manor was held by Wulfwine in 1066, and was assessed at over 3 hides in all. In addition the record lists 33 villeins, 29 bordars, 10 slaves, 13 freemen and 15 burgesses of Sudbury who were assessed with the manor. This adds up to 100 households - a considerable settlement.
A nunnery at Castle Hedingham was founded by Aubrey de Vere, 1st earl of Oxford, and his wife Lucy, some time in the 12thc. In 1191 their son Aubrey confirmed the gift, and added the church of Castle Hedingham and a wood in Gosfield. The manor remained in de Vere hands until the early 18thc.