Our favorite was The Thayer, but if we couldn't stay there, we stayed in Fishkill, Nanuet, Nyack and White Plains. If you fly into Stewart, the Homewood Suites is nice.
We favored flying into Stewart, if possible. It tends to be more expensive, but we found a few times where it wasn't more than NYC or White Plains. Our second favorite airport was White Plains. Closer to WP than NYC. Smaller airport without the crowds of NYC airports. We avoided the NYC airports as much as possible because, for us, it was more difficult to get to WP. We always wanted to rent a car and driving through NYC was not something we relished.