Facial Hair Wont grow properly?

I am 29 years old and every time I try to grow some facial hair it never works. It grows along the jaw line and on the chin but I get patches in the following places. The middle of my upper lip, the middle of my chin and on both sides of my jaw line. The more I grow it, the more the patches become noticeable and so then I shave it off to stop any banter from friends and family. I have grown it for up to 8 weeks and it still isn't right. I just wanna grow some facial hair, I like the look of having some on the jawline and chin. I don't get any hair on my chest either, only around my but I shave this off cu it stands out when I have no top on. Is there anything I can do to get the hair to grow in the patches? I heard testorone shots work but will the GP consider these?