I'm so sorry this has happened. As you say, it's probably best you stay away from this girl although I can understand how difficult it must be to have your social life dictated to you by your brother.
Have you and your mum spoken to the Police about these threats - if you're both scared he could attack you, he really needs to be stopped somehow ....