Not sure what their budget is, but Le Petit is on the water in Grand Case and is one of the best places to stay on the French side. That would be my recommendation. (Although they probably have a minimum night requirement, which the OP may not be able to satisfy.)


Carol Hill