If we view the evolution of monogamy mating systems in humans through the lens of human society it is clear that it takes a huge amount of social effort to maintain and protect more than one mate at a time. It is only when males have access to additional resources and power that they can protect multiple females, usually by ensuring other males protect them. So monogamy seems to be an adaptation to protect one’s mate and children from other males. This monogamy is reinforced by the high social cost and stress of attempting to do this for multiple partners, and it has become supported by cultural norms.
So when living in complex human societies the largest and most important sexual organ is the brain. Somewhere in our evolutionary past how smart and social we are became the major control on our access to sexual partners – not how big or fancy a male’s penis is.