How can we get rid of thrush?

First, you should both have a swab taken next time he has symptoms, to check that this really is thrush, and not something else.