In the 1820s Brompton-by-Sawdon was described as a parish in the wapentake and liberty of Pickering Lythe, 8 miles SW. of Scarborough. Brompton is said to have once been a residence of the Northumbrian Kings. The foundations of an ancient building are still visible on an eminence, called Castle Hill, now surrounded by venerable pines.