The church is in the centre of a busy town but in a relatively quiet and open situation with a large churchyard, a formalised park, to its south and south east. It has been largely rebuilt in various post-medieval Gothic styles: the tower dates from 1785, the remainder from 1823, 1884-5 and 1895. The north and south arcades of the nave were spared demolition and are of 13th-century date (Pevsner 1967, 178-9), having clustered piers with annulet rings, waterholding bases and pointed arches. A small area of Anglo-Saxon wall remains above the north arcade.
Around 1995, the east end of the church was converted into meeting rooms, a chapel, refectory and an heritage centre in the former south transept. In the heritage centre the Anglo-Saxon and Romanesque sculpture which was largely found in the walls as the medieval church was demolished is displayed. The nave was re-ordered in 1996 so that the congregation faces the main altar at the west end, and the former nave and aisles are open, with chairs and no screens (Middleton 2006, 4, 24).
Four grave slabs and a headstone in the Heritage Centre are possibly of twelfth-century date, according to Peter Ryder (1991, 20-22); a further fragment illustrated by him is reset in the wall of the vice in the west tower, now accessed from the vestry behind the main altar.
The ‘Minster’ status was revived in 1993, (Middleton 2006, 5), but the current edition of Crockford’s Directory does not use this title, only All Saints.