I feel that, don't remove the 3rd party straightaway as your husband may turn for the worst, resentful.
You should solve the problem together.
There was something that went wrong or missing in his life that got him going that way. It is that "missing thing" that the other girl is filling him...