Should I have w/ this guy, just so I won't lose him?

He and I met 4 years ago, back when I was dating this girl I loved. We met at a Football game, we were both (RB)s. back then he was dating a girl too. I don't know how it happened, we ran into each other, my gf and I were going to buy pizza and he came out of nowhere and bumped into me, made me drop my money...(He and I weren't playing) It was a Varsity Game, he and I were both freshman at different schools) I got a little angry but then when I saw his face, I don't know what happened, I couldn't get him out of my head. My gf and I bought the pizza and went back to our side. then I went to the restroom and he followed me. He walked in and apoligized again, and then we started talking about football, about how one day that;d be us in that field VS each other. He asked me for my cell number, and then about a week later he called me and invited me to his house, and we went hunting w/ his brother and his mates. and we didn't see each other for a year after that. He then found my profile on myspace and added me as a freind, and we would chat for hours on that thing. I told him I thought it was funny how he found me on myspace and he said he had bn searching for me like crazy. I always knew this guy had a thing for me. By this time I was single and having w/ I don't know how many girls. I was out of control. I still liked him, but was never able to feel anything for him. I wanted to love him, but I couldn't because I felt no attraction. When I told him this, he told me to **** off, that he was happy w/ his gf and didn't want to be w/ someone like me. 4 weeks later he called and asked me if I was ready, I told him I loved him as a freind, not as anything else...He's now in college and we haven't spoken/seen each other for over a year. I still think about him and love him. But I don't want to have w/ him.