Land in Downham was bought by Aethelwold and Brithnoth c.970, and given to Ely Abbey, and a further 2 hides were given by Siverth. In 1086, therefore, the manor belonged to the demesne of Ely Abbey. When Ely became a cathedral in 1109, Downham was allotted to the bishop, and the manor house became a Bishops' Palace and remained so for ma=ore than 500 years. The advowson of the church was always with the manor and was still held by the Bishop in modern times (VCH).