Architectural accolades and illustrious owners are part of the history of this country estate 25 miles from London