I really need some advice from the fellow ab/dl community.

So I live with my boyfriend and daughter. We are both fairly young parents, in our early 20's trying to figure out life. He knows about my secret about being a DL and he is not into it, but he plays with me and lets me wear them. We have been fighting often recently and every time that I bring up leaving him, he says that he is just going to bring up the fact that I like to wear diapers so he can get full custody of our child. I understand that probably that alone would not be grounds to prove me an unfit parent, but I know that being a DL is looked at badly and can give off the wrong ideas. A lot of people associate it with being a pedophile, or having something mentally wrong with you. Neither of these things are true at all in my case, but I am just wondering that if the situation ever occurred and it was brought up somewhere that I enjoy wearing diapers, would that effect my custody of my daughter? He has pictures of me wearing and text messages playing around that involve diapers. I don't know what to do or if I should be worried about leaving him and losing my daughter.

I really need some advice from the fellow ab/dl community.