Over one-third (39%) of software developers have little to no trust in AI-generated code despite most admitting to using AI coding tools daily, new research shows.
Google’s ‘State of DevOps’ report found over 75% of surveyed developers use AI for at least one daily professional responsibility. Chief among use cases is code generation, with 74.9% using the technology to write code.
While over a third of respondents reported the productivity benefits of AI, many lack confidence in the code produced.
This low level of trust expressed by respondents indicates a need to manage AI integration more thoughtfully, the report said, and teams must ensure they evaluate AI’s role in workflows carefully to mitigate downsides.
It’s worth noting that the majority of those surveyed (87.9%) reported that they had at least some level of trust in AI-generated code.
There are also issues in software delivery performance. The increase in AI adoption was mirrored by an estimated 1.5% decrease in software delivery throughput, the report explained, along with an estimated 7.2% reduction in software delivery stability.
“Our data suggest that improving the development process does not automatically improve software delivery — at least not without proper adherence to the basics of successful software delivery, like small batch sizes and robust testing mechanisms,” it said.
The report suggested three recommendations on the back of its findings, such as the establishment of clear guidelines for AI use, addressing procedural concerns, and the assurance of open communication around AI impact.
Google added that businesses should encourage the exploration of AI tools and create time dedicated to AI experimentation.
Do AI coding tools cause more harm than good?
Google’s research marks the latest in a string of studies exploring the benefits and potential pitfalls of AI coding tools, with developers flagging repeated concerns over code security and consistency.
A recent study from Black Duck Software aligns closely with Google’s study, highlighting growing distrust among developers with regard to AI-generated code quality.
The study, published earlier this month, found that around 90% of developers are using the technology in their daily workflows. However, less than one-quarter of respondents described themselves as ‘very confident’ in their organization’s policies and processes for testing AI-generated code.
Notably, issues with code quality were found to be slowing down development lifecycles due to the fact security testing practices had to be expanded to accommodate for potential inconsistencies.
RELATED WHITEPAPER
Similar research from Gitclear found that AI-generated code can be often of a lower quality and is more difficult to maintain, while news earlier this year revealed code generated by GitHub Copilot could be dangerously flawed.
On the other hand, research from GitHub found software development teams created more secure software and better quality code through the use of AI coding tools.
Despite lingering concerns, research has highlighted the benefits of AI coding tools for developers globally. A study from GitHub in August found the use of AI coding tools has significantly improved productivity and helped reduce strain on developers.
A key benefit highlighted in the study was the time savings afforded by the use of AI tools, according to GitHub. Nearly half (47%) of respondents stated they’ve been able to free up more time to ramp up collaboration with peers and focus on system design, for example.
Other developers reported that the time savings afforded by AI tools has allowed them to learn new coding languages.
-
Bigger salaries, more burnout: Is the CISO role in crisis?In-depth CISOs are more stressed than ever before – but why is this and what can be done?
-
Cheap cyber crime kits can be bought on the dark web for less than $25News Research from NordVPN shows phishing kits are now widely available on the dark web and via messaging apps like Telegram, and are often selling for less than $25.
-
Turns out AI isn't that popular at work – just 4% of workers use the technology in the majority of daily tasks, but developers are among the top early adoptersNews Research from Anthropic shows that while AI adoption is sluggish in most professions, software developers and writers are very keen.
-
GitHub's new 'Agent Mode' feature lets AI take the reins for developersNews GitHub has unveiled the launch of 'Agent Mode' - a new agentic AI feature aimed at automating developer activities.
-
AI helped Google engineers cut code migration times in halfNews The firm also simplified communications as migrations can be completed by a single engineer
-
Google Workspace is getting a Gemini makeover – but prices are going to increaseNews The new pricing structure may help Google boost competition with Microsoft
-
GitHub just launched a new free tier for its Copilot coding assistant – but only for a select group of developersNews Limited access to GitHub Copilot in VS Code is now available free of charge
-
Are ‘ghost engineers’ stunting productivity in software development? Researchers claim nearly 10% of engineers do "virtually nothing" and are a drain on enterprisesNews The study used an algorithm to assess the amount of work being done by software engineers at hundreds of firms
-
GitHub says Copilot improves code quality – but are AI coding tools actually producing results for developers?News Questions over the true impact AI coding tools continue to linger
-
Python just brushed past JavaScript to become the most popular programming language on GitHub – and a key factor is that AI developers love itNews The meteoric rise of Python shows no sign of stopping
