By Domesday, Harpsden was held by Alfred from Miles Crispin who had acquired it with other holdings from Wigot of Wallingford. No church is mentioned. Harpsden is one of a handful of small estates of around five acres each that were detached from the royal estate of Benson, pre-Conquest. See also Rotherfield Peppard, Oxon and Rotherfield Greys, Oxon. The manor was divided between two estates, Harpsden and Bolney. By the early 12thc, each appears to have had a church but both estates declined rapidly and by the mid 13thc they were among the poorest parishes in the deanery of Henley. The two parishes were amalgamated by the mid 15thc and Bolney church has left no remains. St Margaret's today belongs to the benefice of Shiplake with Dunsden and Harpsden.