The eyebrow took a long time to grow back.
Sadly my waistline has expanded beyond the confines of that kilt. However I do have a sulu I picked up in Fiji and wear around the house sometimes. It's very comfortable in hot weather. It also shocks Jehovah's Witnesses, but that's not intentional, I discovered it by accident...
For most of history men have worn some form of tunic / kilt / skirt-like-garment. It's only in very recent centuries where fabrics have become simultaneously affordable and strong enough for trousers to become an everyday-wear item. So this whole trousers / skirts dichotomy is missing the point in my opinion - historically it hasn't even been a question. Furthermore, to be honest, there are anatomical reasons that mean that the healthiest attire for a man is a kilt or such garment worn commando, it lowers the temperature of the testes and increases sperm count - seriously, that's
science. The only reason men started wearing trousers is for practicality in certain manual labour tasks. The fact they became commonplace is just fashion, and I ignore fashion...
@rockfox has correctly brought this back to the point of the matter - what kinds of clothing constitute feminine attire?
And I would answer that by simply saying "if she's obviously female, she's in feminine attire", vice versa for men, and "if you can't tell, they're doing it wrong".
So if a woman's in trousers but wearing a feminine top and long hair, so you'd never be confused, that's no problem. And that's the most practical attire for horseriding or many other activities. And if a man's in an obviously masculine-looking kilt, there's really no confusion - especially if he's got a beard. It's really quite common in New Zealand cities to see men of Pacific Island origin wearing sulus / lavalavas etc, there's still no mistaking that they're men.
Just be clear who you are in a way that is recognisable to those around you.