AWS ditches Nvidia for in-house 'Inferentia' silicon
Alexa queries and facial recognition data will now be processed by Amazon's own chips


Amazon Web Services (AWS) will ditch Nvidia chips responsible for the processing of Alexa queries and will instead use its own in-house silicon, the company confirmed on Friday.
The cloud giant will also be shifting data processing for its cloud-based facial recognition system, 'Rekognition', over to these in-house chips, according to Reuters.
Alexa queries, issued through Amazon's Echo line of smart speakers, are sent through the company's data centres where they undergo several stages of processing before coming back to users with an answer, including translating the processed text into audible speech.
The company said that the "majority" of this processing will now be handled using Amazon's own "Inferentia" computing chips. These were first launched in 2018 as Amazon's first custom silicon-designed chips for accelerating deep learning workloads.
Amazon has said that the shift to Inferentia for Alexa processing had resulted in a 25% latency boost and 30% lower cost. The firm hopes the same will happen with its Rekognition system, which has also started to adopt the Inferentia chip.
The cloud giant didn't specify which company previously handled Rekognition processing, but the service has come under some scrutiny from civil rights groups for its involvement with law enforcement. Police were temporarily banned from using it earlier in the year, following the Black Lives Matter protests.
Nvidia and Intel are two of the biggest providers of computing chips, often for data centres, with companies like Amazon and Microsoft included in their clientele. However, a number of firms have begun to move away from vendors and are bringing the technology in-house. For example, Apple has recently moved away from Intel chips in favour of the A14 Bionic processors, which will be used going forward.
Get the ITPro daily newsletter
Sign up today and you will receive a free copy of our Future Focus 2025 report - the leading guidance on AI, cybersecurity and other IT challenges as per 700+ senior executives
Bobby Hellard is ITPro's Reviews Editor and has worked on CloudPro and ChannelPro since 2018. In his time at ITPro, Bobby has covered stories for all the major technology companies, such as Apple, Microsoft, Amazon and Facebook, and regularly attends industry-leading events such as AWS Re:Invent and Google Cloud Next.
Bobby mainly covers hardware reviews, but you will also recognize him as the face of many of our video reviews of laptops and smartphones.
-
Bigger salaries, more burnout: Is the CISO role in crisis?
In-depth CISOs are more stressed than ever before – but why is this and what can be done?
By Kate O'Flaherty Published
-
Cheap cyber crime kits can be bought on the dark web for less than $25
News Research from NordVPN shows phishing kits are now widely available on the dark web and via messaging apps like Telegram, and are often selling for less than $25.
By Emma Woollacott Published
-
British Gas launches trial scheme to reuse waste heat from data processing – and it involves installing a tiny ‘virtual data center’ in homes
News British Gas is carrying out a trial using excess heat from data processing to provide free hot water in homes.
By Emma Woollacott Published
-
The foundation of data center modernization
Whitepaper Choosing the right processor is more important than ever
By ITPro Published
-
Winning the data-centric digital business in this decade
Whitepaper Discover more about Dell’s adaptive, secure, and resilient portfolio for the digital business and win in this data-centric era
By ITPro Published
-
Why energy efficiency could be key to your business’ success
Supported editorial An energy efficient data center setup can help save on bills, but the benefits don’t have to stop there
By ITPro Published
-
Digital Twins - Transforming supply chains and operations
Whitepaper A virtual view of products, processes, and operations, as well as the impact of various factors on performance
By ITPro Published
-
UK's EfficiencyIT launches prefabricated data centre offering
News The company has previously built modular data centres for government and defence customers in 12-16 weeks
By Zach Marzouk Published
-
AWS layoffs: Why Amazon is cutting staff from its most profitable division
News AWS layoffs follow a period of slowing growth and decreasing market share for the cloud division
By Ross Kelly Published
-
Equinix is growing data centre-powered fruit and veg
News The data centre company has installed a rooftop farm at one of its sites to make use of excess heat
By Zach Marzouk Published