Post-Divorce Hookup

After my divorce, I wanted to clear my head by focusing on myself. But last weekend, something unexpected happened. I ran into an old colleague at the gym who looked different and more appealing than when we worked together. We started chatting and ended up going back to his place for coffee and a chat. The connection was there from the start; it felt right in some way. Before long, we moved past the small talk and were exploring each other physically. It happened, but I'm still trying to figure out if it's okay or not considering where my life is now. Should I be concerned about this? Is it common for someone just moving on from a marriage to make these kinds of decisions?