your ex's attitude is insane. In traditional societies, mothers are not isolated. there are grandmothers, aunts, cousins, neighbors - people to lend a hand.
the last church I was at, they acknowledged that mothers of young children needed time to themselves and had a "mother's day out" program -a couple of times a week, they provided free daycare for a few hours so mothers of babies and toddlers could get some time off.
My parents are from India, my dad still would take the kids to the park a couple of times a week so mom would have time to herself.
I am so sorry your ex was so lacking in understanding.