In 1066 the manoir was held by Eadgifu the Fair, said to be the mistress of King Harold II, and in 1086 it was held by Count Alan Rufus, 1st Lord of Richmond and was rated at 7 hides. At Alan's death it passed to his brothers, the youngest, Stephen, inheriting in 1093. He died in 1035 and it passed to his son, Alan, who died in 1146 and then to his son Count Conan (d.1171). The larger part of the manor was held in demesne by the Richmonds until the early-13thc.