This is a doctor directory for Geneva. 

http://www.amge.ch/index.php?option=com_medecins&Itemid=67

one of the factors they list in the search is language ability.

Try clinique Genolier;-)

I was kind of hoping to get a referral from people who like their doctor as opposed to a list of doctors who claim to speak english.

I've used amge.ch more than once in the past and have not had a good experience. For example, the last specialist I picked out from the list turned out to be 80 years old with extremely poor english and had to refer me to another specialist because she wasn't sure what to do.  I had to pay a consulting fee for that....ridiculous. 

The problem is that some doctors are listing themselves as english speakers but they don't actually know the medical term for some words in english and this is really where I'm having the language issue in french. 

I went to Dr Vine at the medical centre in Onex. Luckily I have only had to go to the doctors once but if I had to go again it would be to him. His english is fluent and to me he didn't even have an accent and was a very nice person.

THere is in Versoix Dr. Stamm. He speaks English very well, he is easygoing, and most important  he is very competent.

STAMM Jean-Pierre
Médecine générale
Route de Sauverny 10, 1290 Versoix
022 755 25 27