A house was built by Captain Cotton who acquired the site and much of the land around it, in 1720. The house was sold to Captain Burns and then to Peter Burgess (one of the first elected commissioners for Ramsgate).
Improvements were made with successive owners until in 1880. Southwood House was bought by
Henry and Lady Rose Weigall. During WWI it was used as a convalescent home and the estate is now "Southwood Gardens" and Ramsgate Football Ground.