I think I dodged a Bullet, Right?

Yes I think you did right. You should always hold true to your values and belives. If he really likes you he will ask you out a few times before he tries.