I regularly wear panties and fancy underwear. I always have and I e been confident about it. Been married 20 years and have two kids. It’s just my underwear and that’s what I would say if they said anything. Grew up with a major underwear kink which turned in to a panty/lingerie kink.