I believe you already have an answer in your heart. Which is to continue to stay. Since you said he is a responsible Father, I believe the bond between daddy and the kids should be very strong. If you can tolerate to stay in the marriage for the sake of your children, that will be the best :)