Holy Cross has a nave with a three-bay N aisle, chancel, W tower and the remains of a chapel to the W of the tower. Construction is of stone rubble except for the chancel E wall (of ashlar). The nave is early 12thc. and retains its W doorway (now inside the 13thc. tower) and its chancel arch. The N aisle was also added in the 13thc., but its N wall was rebuilt in the 14thc. The chancel and the S nave wall were rebuilt c.1400, and at some later time the chancel was shortened and the E wall rebuilt. The remains at the W end indicate that a chapel was built here c. 1500. The date of its demolition is unknown. There was a restoration in 1889, and the S porch dates from this campaign. Of the early 12thc. work, only the W doorway and the chancel arch remain.

Bury does not appear in the Domesday Survey. The full name is Bury-cum-Hepmangrove, and the two were originally separate manors, which were united at some time before 1538. It was originally a chapelry of Wistow (held by Ramsey Abbey in 1086), but by 1178 it had become the parish with Wistow as its chapelry, although Wistow regained its separate identity by 1351. Bury also gained Upwood, and Little Raveley until a separate eccesiastical parish was formed in 1746. Bury also gained part of Ramsey parish at the Dissolution.

Benefice of Warboys with Broughton and Bury with Wistow.

Chancel arch and W doorway belong together, and to the years around 1100. Bury's chancel arch is certainly the earliest of the double-respond type in the county. Others are found at Morborne and Warboys. Opus reticulatum, as seen on the W doorway tympanum, is not common in the area.