The Building and Site. The boxy, mixed-use building stood just north of the Market House, the surviving structure known today as Old City Hall. It was built at an unknown date by Oswego businessman and developer Sylvester Doolittle (1800–1881), who erected a number of commercial structures in the Lake Ontario port city. The building was a nondescript wharfside affair.