Give it another go? What a joke.

My husband and I have been together for 12 years, 5 of those married. I would have said that we were a happy couple, never really got into arguments, had no issues with intimacy, etc.
That's why I was completely blindsided 1.5 years ago when I was 12 weeks pregnant with our second child to have happened upon locked, encrypted explicit messages with our old next door neighbour.
How did I find them? Well, he was the last person to log into Facebook on my browser, but the autofill didn't come up for the password, which had been the same for the last 10 years at least. So I grabbed his phone one night and managed to get the password from there; I logged in randomly one day and happened to see messages from just that morning to our old neighbour attempting to organise a meet up so he could do all sorts of explicit things in her. He had obviously deleted the rest of the conversation(s), because I could only see like 4 messages.

I rang him at work, told him to get his ass home, and confronted him.
He told me there was just one occasion where he felt her up over the back fence, but there were no other instances in which they had done anything physical. It had all been dirty talk via message, allegedly.

I kicked him out for a week because I couldn't handle seeing him, then told him he needed to come home because our son needed to spend time with his father.

Fast forward, we decided to try and make it work, engage in counselling which never progressed past a session, and lots of discussion between the 2 of us on how we were going to try and get past this, we decided the only way was complete honesty and transparency. It turned out there had been multiple occasions over the 12 years we have been together that he was cheating emotionally, by messaging or explicit flirting in the workplace.

Me, not be transparent, and obviously not trusting, decided to instal a spyware app where I could trace incoming/outgoing calls and messages as well as browser history (including incognito). All seemed to be going well. When I've checked in with him, he said he hasn't been struggling and all is well.
A month ago, I found him on an online forum that discusses sexuality and people with specific sexual interests, providing them with a place to share content and organise meets. On here, I found a story stating that he had done all sorts of things with co-workers in a back room at work. I'm 98% sure that it is him, but I don't feel like I can openly confront him because of how I have found this information.

I'm so confused and have no idea how to progress.