LGBT :Publishing Book Trouble?

I am trying to get a book published that would mostly fit and appeal to the LGBT community, but two agents rejected me already. It just hurts to think people may not like my book and it has me questioning myself as a writer because I think it is a good book especially since most of it is real. I dont know if it was rejected because it was gay and the agents didnt want that or because it was my writing. I get the same comment in each rejection letter "We feel your book isnt a right fit" idk what to take of that and no other feedack is given...so what do i do are there any LGBT agents or publshers who can tell me what they think or atleast give decent feedback , because family and friends give skewed opinions.