You must go to BOSTON! We had so much fun while son was at AIM last summer, when we picked son up, we carried him back for the day before going back home.
History, food and great pubs everywhere. Also, go to Pizza Regiana (hope I spelled it correctly) while in Boston. Boston newspapers seemed to rate it best in Boston for many years. I can't confirm, as I didn't eat all the pizza in town, but best I've ever had, bar none.
In CT, the sub museum across river in Groton is very good. Gillette Castle State Park in East Haddam is a great stop as well. We'll carry son to it on way to R-day this year. Be careful driving up there, every town is either a Old/New/East/West/North/South Something.
We had lots of fun with that. As far as right in/around New London, we didnt' see much of that, we though if he goes to USCGA, we'll have 4 years to see it. So, we kept our fingers crossed and seems we'll be going back.
Also, no matter how much you want to, DO NOT DRIVE INTO NYC. Take the train. I learn the hard way. 5 hours of hard driving in the city and only covered 8 miles.
Also, for folks from NC. Fayetteville was a 14 hour drive in March when we did the beansprout visit. BUT seems they were getting ready for tons of construction projects, so may be longer now. Good thing is you do not have to get off 95, it carries you right there. Stop in Philly for a cheesestake. Tony Lukes is almost under BUS 95, easy off and back on and great cheesestakes.