It makes your relationship problematic. It matters on dozens of things you never told us. How has he been acting for the last 6-12 months, what are arguments about, does he seem sneaky/guarded? Does he make threats like "If you leave no one would love you" or belittle you - Not those exact quotes but you know what I mean?
It is hard enough to be a women in 2019. Abuse, threats, sterotypes, wag gaps, social expectations and dozens of things. I am no feminist but I work with women who have BPD, C-PTSD;PTSD, BP (Bipolar) and many other things. Its not fair for women. That kind of threat is a red flag. Does he try to manipulate or exploit you in any way or has he ever? Are arguments louder or more frequent?
Often, if he is doing things he should not that type of comment is: Projection, Distraction of Deflection. You can google/yahoo those terms. It depends whats going on....