CFA is pass/fail, BUT. . .
You can earn bonus points on the Whole Person Score by doing extremely well on certain sections, especially mile run, crunches and push-ups. They don't tell you the minimums to pass (don't tell BGOs either), but you can look at the max scores and get some idea of how you measure up.
This past candidate cycle was super-competitive and this upcoming year promises more of the same. You do NOT want to leave "points on the table." So, if your scores weren't pretty close to the max, consider taking the summer to improve, retake the CFA, and submit higher scores. It can only help you. If your scores were at or near the max in all events, then there is no need to retake.
Also, if you are very active in varsity athletics, especially those that require running and/or strength, a mediocre CFA is less likely to hurt you. However, if you don't do varsity sports (or out-of-school equivalent such as swim leagues) and/or your sports are martial arts, golf, sailing, pistol, etc., USNA will look more critically at the CFA.