The first masonry defences seem to have been erected by Count Robert of Eu in the late 11thc., and the church is thought to have been begun before 1094. The property was granted to Sir Anthony Browne in 1547. Excavations were carried out by William Herbert in 1824 for the owner, the Earl of Chichester, and the first comprehensive description was published by Charles Lawson in 1909.