It's because men who are insecure want you to increase their status with your looks according to what they think other men want. They may still be attracted to you but not think you bring them status.

A man who is secure doesn't have to prove anything with who he dates. He can just choose for who matters to him. The differences aren't one to one, but it's a repeating theme because men do notice when they have many choices.