Sounds like they are trying to help you which is good.
Have you told your Dr about stopping the meds and how you are feeling?