Withycombe was held by Geoffrey, Bishop of Countances in 1086, and from him by Edmer. The overlordship passed to the Mohun family after Geoffrey's heir Robert Mowbray forfeited his lands for rebelling against William II. The tenancy, meanwhile, may have passed to William, son of Durand de Mohun in 1166. His son, Ralph FitzWilliam died c.1212, leaving 3 female coheirs of whom the eldest, Lucy, married to William Malet, inherited Withycombe. For later history of the manor, see VCH. The advowson of the church was with the Bishop of Bath in 1194, when he exchanged it with the lord of the manor in exchange for rents. It remained with the manor until the 18thc when the manor was dismembered.