Computers and technology have well and truly permeated our professional and private lives. While this has led to great strides in efficiency, opened up new opportunities for businesses and individuals, and helped us become more connected than ever before, there are also downsides.
As the world becomes more digital and even menial tasks are increasingly outsourced to computer systems, a simultaneous shift in accountability and oversight needs to take place. Trust in computers is all too often automatic, with the pitfalls of this brought to life through the Horizon scandal in the UK. As we move to a future where AI is ubiquitous and computing permeates every level of life, how do we avoid a repeat of this kind of tragedy and move forward using AI in the most ethical way possible?
In this episode, Jane and Rory discuss the fallibility of tech and why business leaders would do well to approach the data they receive from computer systems with a healthy dose of skepticism.
Highlights
“If you were in a self-driving car, a lot of car companies have said, “Oh, but there's still someone behind the wheel. Well, you'd hope that the person behind the wheel knows how to drive so if they veer off course, they can take control. And it's the same thing when it comes to AI systems. The person there, who's approving this flagging this, the buck has to stop with them at least when it comes to accountability. And for that to be the caset hey have to know what they're doing.”
“People who are perhaps a little bit more into this might know that generative AI isn't prone to hallucinations and calling these false outputs hallucinations is kind of erroneous in its own right. They are false outputs. But what generative AI does is hallucinate.”
“It's a genuine concern in academia, a genuine concern in journalism, that somebody might not be doing their own research, this might not be their own work… But ironically, these professors are now putting their full faith in something that alleges it could detect this stuff, even when they normally themselves, by the way, actually can't detect anything.”
Footnotes
- Post Office Horizon scandal explained: Everything you need to know
- OpenAI aims to reduce generative AI 'hallucinations' with new training method
- OpenAI's Sam Altman: Hallucinations are part of the “magic” of generative AI
- Labour must approach AI carefully to avoid repeating a Dutch disaster
- Government urged to save '555' Post Office workers from "financial ruin"
- Use of generative AI in the legal profession accelerating despite accuracy concerns
- What is ethical AI?
Subscribe
- Subscribe to The IT Pro Podcast on Apple Podcasts
- Subscribe to The IT Pro Podcast on Google Podcasts
- Subscribe to The IT Pro Podcast on Spotify
- Subscribe to the IT Pro newsletter
- Subscribe to IT Pro 20/20
-
Bigger salaries, more burnout: Is the CISO role in crisis?In-depth CISOs are more stressed than ever before – but why is this and what can be done?
-
Cheap cyber crime kits can be bought on the dark web for less than $25News Research from NordVPN shows phishing kits are now widely available on the dark web and via messaging apps like Telegram, and are often selling for less than $25.
-
Four-day weeks and Nadella's AGI skepticismITPro Podcast As the Microsoft chief casts doubt on ultra-advanced AI systems, a famous security blogger has fallen victim to a classic attack
-
Creating space for women in techITPro Podcast Tech's huge gender divide can only be tackled with more welcoming, proactive sectoral efforts
-
What is the EU's AI plan?ITPro Podcast As the EU moves to enable AI innovation, it could end up striking the perfect balance between regulation and public support – especially as US AI laws become more complex
-
The trends we’re watching in 2025AI for security and sovereign cloud could be top driving forces in the coming year
-
The 2024 that didn't happenThese are the megatrends of the year that failed to materialise
-
What DORA means for businessITPro Podcast Stringent requirements for third party monitoring and ongoing resilience testing could help put businesses on the best track for security
-
Can the four-day week work for tech?ITPro Podcast As the four-day week gives Icelandic workers a boost, we also look at whether AI coding is up to scratch – and if OpenAI can keep its funding momentum
-
How to sell cyber security without the FUDITPro Podcast A trusted network of cybersecurity marketing professionals can help professionals cut through at the board level
