A castle has existed on the site since 857. In the 13th century, it came into the hands of King Edward I, for whom it became a favourite residence; in the 16th century, Henry VIII used it as a dwelling for his first wife, Catherine of Aragon.The present castle dates mostly from the early 19th century. Its last private owner, Olive, Lady Baillie, left the castle in trust to open it to the public. It has been open since 1976.