USNA can bring in a small number of those with colorblindness. The number is roughly 20, but could be fewer. Bottom line is that USNA is an option but you should definitely pursue other options.
Also make sure you understand that your options on commissioning are limited. You will not be able to drive ships or subs or fly. Your choices are USMC ground and certain restricted line/staff corps positions (e.g., Supply Corp, Intel, CEC, etc.). Maybe cyber -- not sure. These are all important supporting roles, but the "core" of the USN will be off-limits and USMC limited to non-aviation roles.
You would have more options upon commissioning at USMA and USAFA -- but if USNA is your dream, go for it!