The church is largely of the 14thc., and has an aisled nave of four bays with quatrefoil clerestory windows over the piers. The S aisle is original, the N was rebuilt in 1891-92 by W. M. Fawcett, who had restored the church in 1876–77. The chancel is aisleless, its E window (and probably the entire E wall) being 19thc. There is a W tower which is mortar-rendered, but otherwise construction is of mixed pebble and stone rubble with ashlar buttresses, except for the chancel E wall which is of ashlar with brick repairs. Johnson reported a loose 12thc. stone in the church, but this was not found.

The manor of Elsworth passed to the Abbot of Ramsey in 1007, and was held by successive abbots until the Dissolution, except for a short period in the early 1180s when the church was assigned to St Ives Priory, a dependency of Ramsey. The Domesday Survey records that the Abbot held the whole of Elsworth except for half a hide less 5 acres, held by two sokemen from Gilbert of Ghent, and 1 virgate, held by Payne from Hardwin de Scales.