In 1086 Charlbury was almost certainly included in the 50-hide Banbury manor held by the Bishop of Lincoln. Like other estates in this hundred, it had probably formed part of the possessions of the bishopric of Dorchester before the see was transferred by William I. In 1094 Robert, Bishop of Lincoln, granted Charlbury in exchange for Newark and Stowe (Notts) to Eynsham Abbey, which thereafter retained the lordship. The church also probably passed to the abbey with Charlbury manor in 1094 (VCH).
The ancient parish of Charlbury included Fawler, Finstock and Walcot, and from the Middle Ages the chapelries of Chadlington and Shorthampton. The latter were served by curates or chaplains attached to Charlbury. Although the other churches later became independent parishes, the hamlet of Shorthampton has remained, and the parish and benefice is named Charlbury with Shorthampton.