Companies to combat AI bias with forensic experts
New breed of specialist could help avoid in-built prejudice and rebuild consumer confidence
Large businesses are about to start recruiting a new type of AI specialist with gusto, but perhaps not of the kind you may expect.
Incidents such as facial recognition software that consistently classified black women as 'male', or concluded that convicts with darker skin were more likely to reoffend than their white counterparts, as well as algorithms denying people loans based solely on where they lived, have led to accusations of built-in racism, classism and sexism in AI systems. This, in turn, has led to decreasing consumer confidence in this new technology.
In order to combat these inherent biases and restore consumer trust by 2023 75% of large businesses will hire AI behaviour forensic, privacy and trust experts, according to research firm Gartner.
"New tools and skills are needed to help organisations identify these and other potential sources of bias, build more trust in using AI models, and reduce corporate brand and reputation risk, said Jim Hare, research vice president at Gartner.
This new breed of expert will help organisations avoid inherent bias in their systems by validating models in the research and development stage, and continue to monitor them once they're in production.
Some big names have already got in on this trend, including Facebook, Google (which was stung by a racist AI scandal in 2015), Bank of America and NASA. For the moment, however, they remain very much trailblazers.
"While the number of organisations hiring ML (machine learning) forensic and ethics investigators remains small today, that number will accelerate in the next five years," said Hare.
Get the ITPro. daily newsletter
Receive our latest news, industry updates, featured resources and more. Sign up today to receive our FREE report on AI cyber crime & security - newly updated for 2024.
Jane McCallion is ITPro's Managing Editor, specializing in data centers and enterprise IT infrastructure. Before becoming Managing Editor, she held the role of Deputy Editor and, prior to that, Features Editor, managing a pool of freelance and internal writers, while continuing to specialize in enterprise IT infrastructure, and business strategy.
Prior to joining ITPro, Jane was a freelance business journalist writing as both Jane McCallion and Jane Bordenave for titles such as European CEO, World Finance, and Business Excellence Magazine.