I say, and with God's success: If the interest lies in raising them by not visiting the wife's relatives, then he may prohibit it. If there is no interest, then it is not permissible to prohibit it due to the severing of ties and connections between people. And God knows best.