The village is dominated by Gilling Castle, which was mainly constructed during the 16th century and remodeled during the 18th century. There are, however, significant parts dating from the 14th century, but no evidence of an earlier building. The land around Gilling East appears to have changed hands frequently from the Conquest to the end of the 13th century, including the Mowbray family, who had significant holdings throughout this region. It is reported that the church and surrounding land were granted to St Mary’s abbey in York, by a member of the Vescy family, who were tenants of the Mowbrays. Eustace (Vescy), who confirmed this donation, died in 1157.