Swallowfield was held by the king in 1086, and no church was mentioned at that time. Gilbert de Breteuil might have held Swallowfield from the king at this time, but the evidence is contradictory (see VCH (1923), 267). By 1166 the overlordship was held by William, Earl of Warwick, and it was held from him by the St John family. After the death of Roger de St John in 1265 it was granted to Roger de Leybourne, but was returned to the St Johns before 1316.
The church was originally a chapel of Shinfield and was granted with Shinfield to the abbey of Lire by William fitzOsbern, passing later to the lords of the manor and from them to the Dean and Chapter of Hereforford cathedral c1294. The advowson was still with the cathedral in 1923.