Don't think much of it. If you just called him sexy he probably didn't even realize it. Latte once told me I was sexy thinking the exact same thing as you, and I didn't even pick up the whole flirting thing. If you want him to actually know you think he is attractive you gotta be more up front about it... "my god you are ****in hot" would be appropriate.