The church incorporates Anglo-Saxon and late 12thc. fabric, the latter including a pointed arch with an impost block decorated with large dogtooth. No Romanesque sculpture remains in situ although there are two loose fragments in the church.

Arlington is mentioned in the Domesday Survey, but no church. Powell (1892, 187) reported the discovery of the fragments as follows: 'the walls of the porch were found to be unsafe and built up in them were found pieces of Norman or transitional work in Caen stone, one of which was a small attached column with the base, shaft and cap in one piece'.

The dimensions of the two fragments are not identical, but are close enough to suggest that they belonged to the same sculptural ensemble. While the precise nature of that ensemble cannot be conjectured from the surviving evidence, it is likely to have been an item of interior church furnishing. The two capitals are different, one being carved with waterleaf and the other with stems which may have sprouted volutes, or even crockets. They were probably carved towards the very end of the 12thc.