Latton was held by Bury St Edmund's Abbey as a manor of 4½ hides in 1086, and by Thorgot, a free man, before the Conquest. There was woodland here for 200 pigs and 35 acres of meadow. A second manor of 1½ hides and 30 acres was held by Adelulf de Marck from Count Eustace. This had woodland for 300 pigs, 35 acres of meadow and a priest who held half a hide belonging to a church. Finally a manor of 2½ hides and 30 acres was held by Turgis from Peter de Valognes, which had been held before the Conquest by an unnamed free man. There was a priest here too, as well as woodland for 350 pigs and 35 acres of meadow.
The first of these was apparently united with the abbey's manor in Harlowbury shortly after the Domesday Survey, the second became the manor of Mark Hall, and the third became the manor of Latton, or Latton Hall whose demesne was in the area around the church. The overlordship of this manor remained with the Valognes family (the honour of Benington) until 1235 when the honour was divided between coheirs, and Latton fell to the share of Isabel Comyn, whose son William Comyn was holding it in 1270. The tenant in 1184, 1197 and 1201 was Ralph of Latton. The overlordship of Mark Hall manor descended with the honour of Boulogne while the tenancy remained in the family of de Merk until the death of Henry de Merk in 1291. The advowson of the church was shared between Latton Priory, who had probably received it from Mark Hall, and Latton Hall.