William the Conqueror gave Ernulf de Hesdin, a Flemish knight and one of his high-ranking followers, eleven manors in various parts of England, including Norton in Oxfordshire. Ernulf made Norton (later Chipping Norton) his main residence. In 1086 his holding there is recorded as 15 hides. He soon built the motte-and-bailey castle, probably in wood initially, further down the slope from the church. By 1130 the castle belonged to William Fitzalan, who had supported Matilda against Stephen, thereby saving his property from destruction when Henry II became king. Both Ernulf and his son had met untimely deaths by 1138. The son's sister, Avelina, had married Alan FitzFleald, and the manor of Norton passed to them and eventually to their son, William Fitzalan, lord of Clun in Shropshire. In 1181 he sub-divided it through the foundation of the priory of Cold Norton with a community of Augustinian canons. The manor remained with the Fitzalans until 1399 (Eddershaw, 2006).
The benefice of Chipping Norton includes Over Norton, the villages of Chastleton, Cornwell, Little Compton, Little Rollright, Salford, and the parishes of Churchill and Sarsden, Kingham and Daylesford.