The Baths is pretty crowded almost any time of year if you go around noon. As others have suggested, go early in the morning or later afternoon and it will be fine. We were there around December 29th (very busy season) a couple of years ago and in the last hour before sunset there may have been two or three other people there aside from our little group. It was incredible. And this is totally doable if you are going by car.