AI-infused hiring programs have drawn scrutiny, most notably over whether they end up exhibiting biases based on the data they’re trained on.

New York City businesses that use artificial intelligence to help find hires now have to show the process was free from sexism and racism.

  • nodsocket@lemmy.worldEnglish
    11·
    2 years ago

    One easy way to prove that the AI is racist is whether race is one of its parameters. However, it is possible for an AI to be racist even without an explicit parameter.

    • reilwin@lemmy.worldEnglish
      3·
      2 years ago

      Not necessarily, something that overt would be obvious and avoided. I’m pretty sure that what they’re looking for is more for subtle biases caused by bad datasets to train the AI.

      For instance, you train the AI and tell it which candidates are good or bad. But maybe, by pure happenstance, the best candidates in your dataset are all male. If so, the AI might be accidentally trained to believe that all good candidates are male.