Twilio is enabling developers to create multi-user augmented reality experiences, combining rich virtual content with AR via a set of APIs and media server infrastructure.
Twilio's Programmable Video comprises media servers, which deliver low-latency sound and video streaming to the customer's exact specifications. It works alongside the DataTrack API, which shares metadata between endpoints, including information about the AR objects or information to relay the audio and video streams as responsively as possible.
The MediaSync API syncs the AR metadata and content to ensure video is streamed inline with the AR experience. It works on both Android and iOS devices to ensure a consistent experience across mobile devices.
"Augmented reality is completely transforming the way we understand and interact with the world around us, especially in terms of remote collaboration," said Rob Brazier, director of product for Twilio's Programmable Video platform.
"Imagine if the next time you called your cable company, you could simply show them a video of the flashing lights on your cable box and they could instantly know what's wrong, and then guide you through the process of wiring it up correctly by overlaying the correct cabling on-screen in your physical space. The prospects for improving remote support and sales conversations is incredible."
Some of the things Twilio's Programmable Video can be used for include collaboration on 3D assets for industries such as engineering or architecture where it's possible team members will be working remotely but may need to understand the structure, telepresence to merge emotional, physical and verbal information or real-time translation of content into a user's language, with subtitles appearing on-screen.
Twilio's Programmable Video offering will work with other AR technologies such as Apple's ARKit and Google's ARCore, making it a universal option for developers wanting to innovate with new AR apps and services.
-
Asus ZenScreen Fold OLED MQ17QH reviewReviews A stunning foldable 17.3in OLED display – but it's too expensive to be anything more than a thrilling tech demo
-
How the UK MoJ achieved secure networks for prisons and offices with Palo Alto NetworksCase study Adopting zero trust is a necessity when your own users are trying to launch cyber attacks
-
Critical capabilities for full Life Cycle API ManagementWhitepaper Software engineering leaders should use this research to assess and compare the capabilities of 17 products across five use cases.
-
Magic Quadrant for Full Life Cycle API ManagementWhitepaper Assessing vendors in the fast-evolving full life cycle API management market to help software engineering leaders pick the right one
-
OpenAI launches ChatGPT API for businesses at competitive priceNews Developers can now implement the popular AI model within their apps using a few lines of code
-
Nucleus Research ROI guidebook: Informatica iPaaSWhitepaper Connecting disparate applications and data deployed in diverse environments
-
Rackspace taps Digivante to offer AI-based application testingNews The partnership is aimed at improving software delivery and reducing test cycle times
-
OpenAI tool previously thought 'too dangerous' for the public goes generally availableNews The natural language processor has previously been found to generate racist and other types of prejudicial content
-
Facebook reveals wrist-based hardware for augmented realityNews The social network is working on a wearable prototype that uses haptic technology
-
Twitter XSS flaw could allow hackers to take overNews A bug found in Twitter’s API still hasn’t been fixed yet.
