Once a working farm, several families lived at the mansion on the property over the years. The main families who called it home are the Roses (1803-1835), the Strongs (1835-1843), and the Swans (1850-1890). Along with the families that called Rose Hill home, several other people lived and worked on the property as well. Farm and house work was done by slaves (1803-1827) and Irish immigrants (1850-1890). In the early to mid-twentieth century, the property served as a farm, summer vacation home, and nursing home. In 1965, Rose Hill Mansion was purchased for the Geneva Historical Society by Waldo Hutchins Jr. in honor of his mother, Agnes Swan, who was born and raised at Rose Hill.   Through the generosity of Mr. Hutchins, the mansion was restored. In 1968, the mansion opened to the public as a historic house museum.