If your soon-to-be-ex will not support your relationship between you and your children, then it is crucial for you to obtain legal custody. This is the only way that both parents' relationship with the children will be assured. Hopefully, you are the more reasonable parent and would not interfere with the other parent's relationship with the children. Since the same can't be said for them, it would follow that you will need to be the one in control of the custody arrangements.
Read these pages to get started: