Upper Hall was formerly the residence of the Lay Vicars of Ledbury Church. There is some evidence for a large medieval building in the massive stone walls exposed mainly at cellar level but in places above. The earliest part of the present building is the eastern half of the south-western range. This Jacobean five-bay building has two main storeys and attics above the cellars and was built between 1660 and 1680. It is of brick with a hipped, tiled roof and a modillioned eaves-cornice, the windows all have late 17th century mullions and transoms. At the eastern end of the Hall is an apparently Georgian wing, it was erected across the eastern end of what is presumed to have been the medieval hall circa 1730. The range is L-shaped and consists of two main rooms on each floor with smaller rooms leading off to the east. The range is of brick with stone quoins and a tiled roof. Joining the two wings is what is now the main part of the building. This range is dated by an inscription `I S 1766, built as a three storey range above the basement. This central range presumably replaced an earlier hall block, internally the range contains a basic framework of two large rooms on each floor. a wing was added to the west of the Jacobean pre-1849. Further extensions were carried out pre-1867 converting the Hall into a Victorian mansion. During the First World War the house was used as an Auxilary Hospital and in 1920 the building was sold to the County Council for use as a Grammar School. The school was extended in 1949 and 1963, in 1978 the school became part of the John Masefield High School. In 1991 the school moved to a new site and the building has been empty since.