My kids are not their only grandchildren but they are the youngest. I tolerated my MIL for a long time. I still remembered how she gave chocolate to my gal secretly when she was a baby. I found out by smelling my gal's breath accidentally. She said my gal need to eat chocolate as it is a good food, ya like real. I told her she is too young for chocolate. For me to respect elders, they need to respect us too. Too bad, Asian parents has the belief they own their kids and grandchildren, so no respect is needed. Anyway, there are many unhappy experiences but I just tolerated.
To answer yr question if my husband has no objection, I would say it took his betrayal 5 yrs ago to take things into my own hands. I lost respect for him over the yrs with no apology. From my own experience, in laws interference can cause stress to yr marriage. So do take note of that.
Things wear out easily when you do not take gd care of them, it is the same with marriage. Too bad, it is my husband who does not take me seriously so I do things my way now. When one has enough and driven to the corner, you just do what is beneficial for yrself. Keeping myself happy and sane is my first priority, giving too much has caused me too much pain.
Do what is right for yr child, and your husband needs to be firm with his parents. Initially, you can still handle it but when such stress continues for a long time, it will wear you out and cause strain to the marriage as well. It is important for yr husband to be on yr side and be firm. It is important for couple to hv the same or similar views on parenting, otherwise long term conflicts will create a lot of problems in future.