We snorkeled the Caves at around 10am and had the place to ourselves earlier in June (dinghy from the Bight).