I don't know what the right thing to do is, but I tried backing off completely and I hated it. I think that you have to acknowledge what you want in your relationship too. If he's struggling fair enough, but you deserve to be acknowledged too.
How long has he been on the meds? If he's still struggling with the bad side effects, it might be worth going back and speaking to his Dr - maybe see if he'd allow you to go in with him, to fill in the parts from your point of view too? I know my husbands GP really liked that we went together... Even if you just wait outside, going and telling someone how you are feeling - intimate details that boys are conditioned out of talking about - is tough...