From the Council of Turin, A.D. 401

Canon VIII. The authority of the synod decreed that those who were ordained against the interdict, or who have generated children in the ministry, are not to be permitted to the greater grades of orders.

Nothing is said here about separation from the women with whom, having been placed in the ministry, they mingled, probably because the speech was about a fornicatory union, but not one even in appearance conjugal.