The site of the old Cowley Manor, a castle-like moated house, is visible on an eminence behind the present building. It was demolished in the early 17th century. Apart from a scatter of stones and an uneven ground surface, at SK 36009568, there is nothing to indicate the site of the house, nor is there any trace of a moat. Survey of the earthworks to the NW of the present house which probably represent the site of the moat and manor house. It seems probable that the main part of the site has been removed by a 19th century quarry. (PastScape)
Dodsworth was informed that the Mounteneys had "great woods, and abundance of redd deare, and a stately castle-like house moated about, pulled down not long since by, the Earl of Salop after he had purchased the land." The site of the old building is still visible on an eminence at the back of the present house. (Eastwood)