In 1827, Hosea Ballou constructed a brick mill on this site and purchased the first privilege to the Lyman Arnold Mill Trench to power it. Unfortunately, he went bankrupt shortly after due to the Depression of 1829.
At that time, Hosea’s brother, Dexter, was operating a successful mill on the nearby sawmill lot. When that mill was destroyed by a fire that same year, Dexter moved his operations to Hoseau's brick mill and flourished.
In 1836, the Great Fire at Canal Square created an opportunity for Dexter to expand his operation. The fire destroyed several small mills that had been operating adjacent to Dexter’s mill. Dexter purchased the property and built a 3-story rubble stone mill on the site. The mill was in the Greek revival style with a brick cornice and wooden stair tower. A bridge over the Lyman Arnold Trench led to the front door.
In 1845, Dexter built a third stone mill connecting the 1827 brick mill to the 1836 stone mill. He called the complex the Harrison Mills. After Dexter's death in 1849, Dexter Ballou & Co. continued to operate the complex as a cotton mill.
Image courtesy of the Osher Map Library