(No, I'm not genderqueer, but I'm interested in different perspectives than my own; I'm only trying to understand the term.)

I understand genderqueer to mean "outside the gender binary". However, doesn't that imply that gender is actually an important concept even outside of a societal definition? In other words, why care about the gender binary when thinking about self-identity? For me at least, I'm male, and certainly look typically male because of the clothing I wear, but I don't care one way or the other if I'm masculine or feminine, I just act how I want. Is there some idea I'm missing about gender identity?

EDIT: Look, the reason I said that "outside the gender binary" is vague/too subjective to me is because I don't necessarily identify well with the gender binary at all, nor do I try to fit it. I just happen to dress in a way that isn't going to make me appear different or outside of a norm. Presumably that makes me cisgender still, but when would saying cisgender stop making sense?