Yes! It is so hard to have conversations with women who have kids when you don't. Once they ask The Question and hear your response it's like there's nothing else to talk about. Womanhood is not contingent on motherhood.
Women are complete human beings, not potential mothers. Motherhood is just an option. And If someone calls you selfish for being childfree, ask them why they had kids. It'll usually start with "I wanted.."