This is one of those self esteem things and really, it IS a big deal. If you assume that a woman is out of your league just because of her looks, then you need to change up how you see yourself. There is very little that you can do to attract beautiful women if you believe that you really do not deserve one.
