297.61.a.jpg     Lee Academy was built in 1821 under the direction of Frederick Lee. It first served as a private secondary school. It was located on the Boston Post Road opposite Capt. Lee's house. Later it was moved to the Green behind P P Coe's Store (Memorial Town Hall) where it faced south. It was moved a third time to a location behind Hand Academy serving as a primary and intermediate school for the Town. Sometime after the building of Hand Consolidated School in 1921, it was moved to the spot it now occupies behind Memorial Town Hall this time facing west. after some heated discussion about tearing it down it was transferred to the Madison Historical Society who maintains an exhibit hall on the ground floor while renting the second floor.