MIT researchers hail "liquid" algorithm breakthrough
A set of differential equations at the base of an algorithm could lead to a more adaptable type of machine learning
Researchers at MIT say they have developed a flexible algorithm that can change its underlying equations to continuously adapt to new inputs of data.
The "liquid" algorithm is said to be a new type of neural network that learns during tasks rather than just in its initial training phase.
It's hoped this new approach could revolutionise technology that relies on decision-making protocols where the data changes over time, or in unpredictable environments, such as medical diagnosis or autonomous driving.
The research will be presented at the AAAI Conference, an artificial intelligence event taking place in Vancouver, Canada, in February.
"This is a way forward for the future of robot control, natural language processing, video processing - any form of time series data processing," says Ramin Hasani, the study's lead author. "The potential is really significant."
Most neural networks have fixed behaviour and they typically don't adjust all that well to changes in incoming data streams. For example, the crash of an Uber autonomous vehicle in 2018 that resulted in the death of Elaine Herzberg, considered the first fatality involving the technology, was said to have been caused by the system being unable to identify the shape of a pedestrian when they were walking alongside a bicycle.
Unleashing the power of AI initiatives with the right infrastructure
What key infrastructure requirements are needed to implement AI effectively?
The neural network designed by Hasani has the potential to avoid these issues by using a set of differential equations as the base of its algorithm, potentially creating a more fluid type of machine learning. The idea is inspired by the microscopic nematode, Caenorhabditis (C) elegans, which has only 302 neurons in its nervous system. Hasani said they can still "generate unexpectedly complex dynamics".
Get the ITPro. daily newsletter
Receive our latest news, industry updates, featured resources and more. Sign up today to receive our FREE report on AI cyber crime & security - newly updated for 2024.
Similarly, Hasani and his team used equations that allowed the parameters of his neural network to change over time. These are essentially a nested set of differential equations that change the representation of the neuron, creating a small number of highly "expressive" ones, according to Hasani.
"We have a provably more expressive neural network that is inspired by nature," Hasani said. "But this is just the beginning of the process. The obvious question is how do you extend this? We think this kind of network could be a key element of future intelligence systems."
Bobby Hellard is ITPro's Reviews Editor and has worked on CloudPro and ChannelPro since 2018. In his time at ITPro, Bobby has covered stories for all the major technology companies, such as Apple, Microsoft, Amazon and Facebook, and regularly attends industry-leading events such as AWS Re:Invent and Google Cloud Next.
Bobby mainly covers hardware reviews, but you will also recognize him as the face of many of our video reviews of laptops and smartphones.