I am bi, my "friends" would hate LGBT people, constantly talk how we're pedophiles and so on, and kept voting for parties against equal rights.
If your "friends" were calling you or your other friends pedophiles (and you are not) then yes, absolutely, you should not be friends with them.
If your "friends" were calling you or your other friends pedophiles (and you are not) then yes, absolutely, you should not be friends with them.