Brassington was held by Siward before 1066 and was assessed for geld at 4 carucates. In 1086 Henry de Ferrers held it in demesne. No church is mentioned in the Domesday Survey.
The church at Brassington was a chapelry of Bradbourne, and when the latter was given to Dunstable Priory in 1278, Brassington was included too. The tithes of Brassington continued in the possession of Dunstable Priory until the Dissolution. The medieval dedication to St James is that most commonly given, but Cox (1877, 447) asserts that the true dedication should be to All Saints. It is unclear which St James is intended, presumably the Greater.