I don’t think that attract men are rarer, societally it just seems like we’re being judged on different scales. Something I’ve noticed, although only anecdotally:
If you get a group of people attracted to women to describe what an attractive woman is, you’ll get a fairly similar answer.
This makes it easier to know where you stand, and also easier to become “more attractive” easier, because there is a fairly consistant goal to be achieved.
If you ask a group of people attracted to men to describe what an attractive man is, you’ll generally get a few different archetypes.
A guy with a beard will get an instant 0 from some people, but it’s a positive for others.
A guy with abs will get an instant 0 from some people, but it’s a positive for others.
A guy with little/no hair will get an instant 0 from some people, but it’s a positive for others.