The roughest part of your trip will be the 90-minutes getting from the South side of St. Thomas into Pillsbury Sound. After that you can hide in the lee of the islands. Drake Channel is pretty moderate. May is a relatively calm time to sail there.