That sort of depends on the sport, among other things.
As a Plebe, the only time you will have town liberty (and be allowed off campus by yourself) will be on Saturdays after LMO (Last Military Obligation), or when your company says so. You will be required to be in uniform, you will not be allowed outside the designated radius from campus, and you will not be permitted to operate a motor vehicle. You will not have much storage space, either. So long as you can remain in those parameters, knock yourself out.
From your username, I'm guessing that you kayak. The good news is that there is water pretty much surrounding the Yard, and there are kayak rentals at Eastern Mountain Sports (maybe others) near the Target store. However, that's a long way to carry a kayak, and it would be hard to do in uniform.
OTOH, if you can get upperclass Mids interested in forming a club, almost anything is eventually possible. I know some Mids who were avid equestriennes before becoming Mids. They have established an Equestrian Club & team, and they have 5 horses at the USNA dairy farm. Now there are club members from all 4 years.