Need to know what happened between my friend and me?

OK here goes. I had this friend that we were really close a couple of years ago. We are both straight men. When we first met and started hanging out, he would call me every day, every morning. We would see each other every day for a beer. I eventually started spending weekends with him and his family (parents). When I would stay over we shared his room, slept in the same bed. Nothing ever happened but we were very comfortable in bed. We would snuggle spoon, sleep in his arms. Then one drunken night, we were wrestling and 1 thing led to another...Nothing happened that night but if we hadnt stopped ourselves, who knows. Since then we have drifted apart big time. Is it possible we were not able to deal with what almost happened?