Should the word "homophobia" be considered hate speech?

I COMPLETELY agree! I feel the same way. I think it's wrong for them to call someone a homophobe because they disagree with their beliefs. Like for example, freedom of religion. What if homosexuality isn't excepted in someone's faith and all they're doing is following it by not excepting it? It's ok for a gay person, or someone who believes in homosexuality, to insult them by calling them a homophobe? I just think that is really wrong, and really unfair.