I'd probably have a back up plan figured out just in case. I know one time when we took the ferry a couple of years ago, we took a ferry at 6 or something like that - Left CA and stopped at Red Hook, West End and then Road Town. Not sure if anything like that is available or not this time of year though.