Can generative AI change security?
The latest developments in artificial intelligence could empower threat actors, but firms should carefully consider whether it fits their stack before diving in themselves


Artificial intelligence (AI) has moved from being a sci-fi staple to a tool that’s in widespread use. Headlines today are dominated with news of generative AI services such as ChatGPT and Bard, the latest and greatest in large language models from firms OpenAI and Google. These promise users a crack at incredibly capable text generation and interpretation based on vast training models, using nothing more complicated than their browser and a keyboard.
RELATED RESOURCE
As powerful tools for text generation, large language models also carry the risk of empowering threat actors. As more people publicly access these systems than ever before, security firms are assessing how chatbots could bolster malicious activity.
In this episode, Jane and Rory speak to Hanah Darley, head of threat research at cybersecurity firm Darktrace, on the potential misuse of generative AI models, and the role the technology can play as part of a wider AI defence arsenal at the enterprise level.
Highlights
“You could do a myriad of things, you could say ‘can you please craft for me a very, very well-written email targeted towards a banker who regularly reads the Wall Street Journal, and can you include specific details’ because ultimately, language modelling is designed off of training data.”
“Our statistics internally found that actually, relying on malicious links had decreased from about 22% of the phishing emails we saw to about 14%. But the average linguistic complexity of phishing emails jumped or increased by about 17% since the outset of ChatGPT.”
“I think in general, it's a great thing that legislators are not only thinking about but actually applying ethical concerns as well as controls onto technologies. Because ultimately, that's how you keep social accountability. I think there is a danger in placing all of your hopes and dreams in legislation, and kind of regulation as the way to go.”
Read the full transcript here.
Get the ITPro daily newsletter
Sign up today and you will receive a free copy of our Future Focus 2025 report - the leading guidance on AI, cybersecurity and other IT challenges as per 700+ senior executives
Footnotes
- What is generative artificial intelligence (AI)?
- What is ChatGPT and what does it mean for businesses?
- OpenAI launches ChatGPT API for businesses at competitive price
- What is phishing?
- What good AI cyber security software looks like in 2022
- Why AI and machine learning are vital cybersecurity tools for 2022
Subscribe

Rory Bathgate is Features and Multimedia Editor at ITPro, overseeing all in-depth content and case studies. He can also be found co-hosting the ITPro Podcast with Jane McCallion, swapping a keyboard for a microphone to discuss the latest learnings with thought leaders from across the tech sector.
In his free time, Rory enjoys photography, video editing, and good science fiction. After graduating from the University of Kent with a BA in English and American Literature, Rory undertook an MA in Eighteenth-Century Studies at King’s College London. He joined ITPro in 2022 as a graduate, following four years in student journalism. You can contact Rory at rory.bathgate@futurenet.com or on LinkedIn.
-
Bigger salaries, more burnout: Is the CISO role in crisis?
In-depth CISOs are more stressed than ever before – but why is this and what can be done?
By Kate O'Flaherty Published
-
Cheap cyber crime kits can be bought on the dark web for less than $25
News Research from NordVPN shows phishing kits are now widely available on the dark web and via messaging apps like Telegram, and are often selling for less than $25.
By Emma Woollacott Published
-
The new era of cyber threats
ITPro Podcast With AI-powered attacks and state-backed groups, security teams face face a new wave of sophisticated threats
By Rory Bathgate Published
-
Supply chain scares and Google’s AI code
ITPro Podcast As the ransomware attack on Blue Yonder disrupts a wide range of firms, Google moves to lead by example on internal AI code
By Rory Bathgate Published
-
Halloween special: Cybersecurity horror stories
Podcast Join us for three terrifying tales sure to chill any IT professional to the core
By Jane McCallion Published
-
Securing your business with education and training
ITPro Podcast Keeping your workforce updated on the latest threats requires a cohesive cyber skills strategy
By ITPro Published
-
Cracking open insider threats
ITPro Podcast Leaders need to perform strict identity measures on would-be hires – and ensure employees who leave have access promptly removed
By Rory Bathgate Published
-
Protecting the public sector from hackers
ITPro Podcast With the public sector facing increasingly sophisticated threat actors, leaders need centralized security plans and better communication
By Rory Bathgate Published
-
How cyber attacks damage mental health
ITPro Podcast As staff struggle to cope in the immediate aftermath of a cyber incident, leaders must do more to foster a culture of support
By Rory Bathgate Published
-
LockBit leader revealed: What it means for ransomware
ITPro Podcast With LockBit's founder having been unveiled publicly and with international law enforcement still digging into detailed attack stats, the group is on high alert
By Rory Bathgate Published