Despite its efficiency benefits, AI code generation and similar solutions may not be the panacea to the ongoing ‘developer crisis’, new research warns.
AI code generation tools may have helped increase velocity, but deployment errors mean devs are becoming increasingly bogged down in manual tasks remediating the systems’ various failings.
A new report from Harness interviewed 500 engineering leaders and practitioners to gauge the impact of AI coding tools on software delivery, assessing the current challenges inhibiting the successful incorporation of AI into the existing modern software development ecosystem.
Harness found 59% of developers reported problems with deployments at least half the time when using AI coding tools.
Although 92% of respondents reported that AI tools increased the volume of code shipped into production, they noted they also increased the ‘blast radius’ of a bad deployment.
In addition, 67% developers said they spend more time debugging AI-generated code and 68% spent more time resolving security vulnerabilities after adopting AI tools.
The report argued that while AI accelerates code production it ultimately creates “new demands around code review, security validation, and quality assurance [QA].”
Developers noted that this “increased verification overhead” offsets a “considerable amount of the productivity gains”.
Harness spoke to engineering leaders about their top concerns about the increased adoption of AI code generation tools and the impact it has had on their workplace.
Just over half (52%) of leaders said they have observed an increase in vulnerabilities and security incidents after their organization started using AI-generated code, as well as an increase in performance problems.
Furthermore, 46% cited a growth in the amount of manual downstream work developers had to do, including QA, testing and integration, as well as a more effort associated with regulatory non-compliance (44%), and a reduction in code quality (40%).
AI coding tools look to help alleviate growing productivity losses in development team
The Harness report argues that the appetite for these AI coding solutions is high due to the increasing pressure software development teams are under to stay on top of ever-expanding responsibilities while ensuring velocity is maintained.
Harness found developers are already struggling with lost productivity due to constant context switching and a litany of manual tasks that distract them from their work.
Over three quarters (78%) of developers said they spend at least 30% of their time on manual, repetitive tasks. This includes writing compliance policies, conducting quality assurance testing, and error remediation.
Bogging developers down with these tasks could have a significant financial impact on your organization, Harness warned, providing an estimate for the cost these solutions have had on productivity overall.
Using the average developer salary of $107,599, Harness found that if devs are spending 30% of their time on manual tasks, this would equate to $32,280 of wasted investment per developer.
Extrapolating this out to the 25 organizations Harness spoke to, this balloons to at least $8 million in lost productivity per engineering team.
Harness added that on top of the financial waste, these tasks are also creating burnout issues by burdening them with an ever-growing workload of manual, repetitive tasks that keep them from coding.
When asked about how many hours they work a week, 88% of respondents said they work more than 40 hours per week. Half of developers said that working overtime like this creates an unhealthy work/life balance, while 46% said it entices them to leave an organization.
Virtually every developer (98%) said they believe AI tools are a great way to reduce burnout, but that although they may help free them up to ship code more quickly, they are still concerned about the potential negative impacts this code could have.
