Willian was held by Geoffrey de Bec in 1086, and before the Conquest it was held by Leofric, a housecarl of Earl Leofwine. Geoffrey's manor was assessed at 5 Hides and 1 virgate, of which 2 hides were in demesne. By the early 13thc the manor was held by William Malet de Graville, said (following VCH) to be the son of Matthew de Graville, son of William de la Rue. On the separation of England and Normandy in 1204, William de Graville lost his lands and Willian was granted to Matthew de Lilley in farm. In 1216 King John granted the manor to Pain de Chaworth, but in 1237 King Henry III committed it to John, Earl of Lincoln. This led to disputes over the title, and in the early 1240s the king took it into his own hands.
In 1243 he provisionally granted it to Paul de Peyvre and his heirs, and it stayed in this line until 1429 when it passed to John Broughton, a grandson in the maternal line of the same family. More recent history may be found in VCH.