It probably depends on how well you do on everything else. These were my scores, so I'm guessing the mile, shuttle run, and sit ups cancelled out the push ups and pull ups.
My advice is this: the mile is the end of the assessment. If one second could be the difference between receiving an appointment or not, wouldn't you kick yourself if you didn't give it EVERYTHING you've got? I was exhausted when it came time for the mile, but I just kept thinking about my goal and I got through it. You most likely won't be getting your personal best in the CFA, but they don't expect you to. They want to see your endurance even AFTER you're already hurting.
My scores: (I'm a girl)
basketball throw: 42
pull ups: 1
shuttle run: 10.2
sit ups: 82
push ups: 24
mile: 7:22