We stayed at the Athenaeum on Piccadilly Street -- it's right across the street from Green Park, a block away from the Green Park underground station, and walking distance to a lot of major attractions. Just try to avoid the townhouse rooms. I blogged about our trip starting here:
Calypso's Odyssey Blog