I do think that feminism has gotten a bit muddy. From my experience, there a few feminists who believe things are good now, there are some who don't think people that aren't women should benefit with feminism, there are people who believe that feminism is dumb while simultaneously advocating for feminist issues. I think certain people (conservatives mostly) have attributed feminism to one type of person and therefore, since that person who calls themselves a feminist must be unhappy, miserable, and man-hating so all must be like that.
I also think that certain feminists don't allow for you to be different in your beliefs while falling under feminism. That may explain why many sectors have been made to exist like intersectional feminist, radical, TERF [although I don't think that sector counts lol]. Since there was no clear defining of 'feminist', it has been bent and twisted every which way to fit any person's idea.
Also, since so-called killjoy feminists have existed for so long, it has been a passed down rhetoric so the people who hate feminists don't really know what they're hating about the movement.