I think you handled the situation well. If you didn't want to talk to him, then what's the problem? He seemed to be socializing with others around him so he was active in those few hours that you saw him. If you wanted to talk to him, I'm sure you would have.