Elsted was held by Bishop Osbern of Exeter in 1086, and had a church. Osbern the cleric held half a hide; Ralph the priest 1 hide 'which belongs to the church'.
The font was given to Elsted church by St Olave's, Chichester in 1956 (Fleming 1957, 10). At St Olave's it had stood 'partly on the gravestone of Richard Young'. An archive photograph of 1955 shows it in situ (Historic England Archive Red Boxes). St Olave's church is now a bookshop.