Is it fair for societies such as Phi Beta Kappa to have to lower their standards to allow more minorities?

They have very strict requirements and race isn't one of them. They go on the numbers and GPA alone yet some people claim it is discriminatory and racist and want the standards lowered to allow more minorities. Why do people want to drag down the hard working and successful just to fit their wants?