Excluding those categories would unquestionably raise the average test scores. By how much is unknown and virtually impossible to calculate by anyone outside of admissions. And as mentioned by USMA 1994, knowing that number is irrelevant to the chances of any individual candidate.
While many recruited athletes, prior service, and minorities have excellent grades and test scores, it is a matter of record that candidates in those groups may be appointed with lower WCS scores (and test scores) than would otherwise be necessary for them to receive an appointment.
It is not unusual for an appointee from USMAPS to have an SAT score below 1,000 and, after completing the rigorous USMAPS program, do well academically at USMA. However, those test scores are part of the class profile "average test scores". Case in point: SAT - 880; ACT - 20; 1st Year USMA GPA - 2.64