You must talk to him, he has right to know and to chose
You can't estimate what he would feel once he knows the fact. Your unhappy just come from your own imagine
Even a guy always say he enjoy freedom, but actually not. People sometimes will feel tired and want to stay, they just don't know when or refuse to decide when to make it happen.
So if you talk to him, his response may be surprise to you and make you happy.
Don't make yourself unhappy and regret again. Just talk to him