The cornerstone for Cary Collegiate Seminary was layed July 4, 1840, and in the fall of 1843 the school was opened. Colonel Alfred Cary gave the land for the school. Four well-known citizens attended opening day: Addison Armstrong, Charles H. Chamberlain, George Fuller and Irving J. Stedman. Attendance numbered 136 during the winter term. A catalogue from the first year stated: "The quietness, prosperity, and delightful situation of the Village, the moral and religious character of its inhabitants, unite with other circumstances to point out this Seminary as a safe and desirable retreat for scholars." Among the scholars of the early years, who in later life became an honor to the school were:
George W. Aldrich, Mayor of Rochester
Dr. Barrett, Professor at the Buffalo Medical College
Charles S. Baker, Congressman from Monroe County