Domesday records two holdings in Monksilver. The larger, assessed at 1½ hides, was held by Richard from Alvred d'Epaignes in 1086, and by Alwig before the Conquest. This manor included a mill, 2 acres of meadow, 160 acres of pasture, and woodland 3 furlongs by 2. The other piece was held by Alric from Roger de Courseulles in 1086, and by Beorhtmaer before the Conquest. It was assessed at half a hide plus 6 acres of meadow, 16 acres of pasture and 16 acres of scrubland.

Alvred's manor was given by Robert de Chandos, who married Alvred's daughter and heir Isabel, to his foundation of Goldcliff Priory (Monmouth) in 1113, and the monks held it until 1441, when the priory and its lands were given to Tewkesbury Abbey. From there it passed to the canons of Windsor by exchange in 1474. The advowson of the church remained with this manor until 1800, when the canons of Windsor sold the manor but retained the advowson. The dedication to All Saints was recorded in 1449 (VCH).