West Point is largely what you make of it--there are plenty of cadets that settle for mediocrity and will fall into cynicism and not do much with their time at the Academy. If you show motivation, dedication, and have a bit of luck, West Point will slingshot you into opportunities very few would dream of at normal universities. I have friends who are going to Ivy League medical schools fully-funded next year, ones who are getting their pilots licenses through USMA, and tons who have spent their summers at Los Alamos National Labs. I know some Plebes who are doing graduate-level research right now. I'm not as good at school as you (I wouldn't have gotten into MIT with my work ethic in high school) but West Point has brought me to the Pentagon to meet GEN Milley and SecArmy, to meet WWII paratroopers, soon to jump school and hopefully some awesome AIADs in my future.
I would say that generally the cadet population is inferior academically to that at top-tier schools. However, the top 10% of cadets, in my opinion, are far superior to those at any other institution. It takes a certain kind of person to get a 4.3 GPA in academics, physicality, and militarily, one that can balance the massive amount of "stuff" that USMA puts on your plate and brush it off like it's nothing. Ask those kids what they did last summer and you'll see what West Point really has to offer. If you're MIT smart, and can do well on a PT test, you'll be with them.
In regards to some of your other concerns--I'll address them since you won't be able to do a candidate visit (I host many CC's). If you go to West Point and hate it, you can leave in your first two years w/ transferable credits and owe nothing. It's hard to get kicked out for an injury; they'll take care of you. I was told there's a firstie on the boxing team who has had 15 concussions and will be commissioning with a waiver that wasn't all that hard to get. Don't decide based on medical. With connecting with others, I have a group of close friends who I would take a bullet for and I wouldn't exchange those relationships for anything. Everyone experiences a common struggle and it connects you more than you realize--I've visited some normal universities on the weekends and I would be depressed there. You have a Team Leader as a Plebe who is supposed to guide you through your first year and show you how to get by and a support network of counselors and chaplains who will answer their phones in the middle of the night. You will learn what the daily life of an officer looks like from your instructors, and we have a whole week every year dedicated to branch displays and representatives. That stuff just doesn't exist elsewhere.
Feel free to PM me if you have more questions; I didn't intend to write you an essay but we have a lot of time to waste with this virus.