It seems to me that many units offer study abroad. I don't know if all have that opportunity.
The NROTC academic advisor at the Univ of Penn NROTC unit told me directly that they encourage their Mids to study abroad as does the University.
If study abroad is important to you then you'll want to research and make sure that you apply to schools that have very good/excellent programs.
I'm not sure if language acquistion is your goal but I was told that students on my son's campus return from the Beijing semester essentially fluent in Mandarin. (No English is permitted except for phone calls to family and rule breakers are sent home.)
I haven't researched study abroad for ROTC or AFROTC
AFROTC also has study aboard, but they don't pay for the tuition of that semster. You also have to double up on classes and isn't for those trying for pilot training slots. You need leadership postions and you can't have those studying aboard.