optical Network Cables

Using machine learning to improve optical networks efficiency

A group of researchers from Universitat Politècnica de Catalunya in Barcelona and Huawei have retooled an artificial intelligence technique used for chess and self-driving cars using machine learning to improve the efficiency of optical networks.

A new machine learning approach could increase the efficiency of optical telecommunications networks. As our world becomes increasingly interconnected, fiber optic cables offer the ability to transmit more data over longer distances compared to traditional copper wires. Optical Transport Networks  (OTNs) are a solution for packaging data in fiber optic cables, and improvements stand to make them more cost-effective.

OTNs manage high amounts of traffic. If the network gives more space than needed for a voice call, for example, the unused space might have been better put to use ensuring that an end user streaming a video doesn’t get “still buffering” messages.

The researchers’ new approach to this problem combines two machine learning techniques: the first, called reinforcement learning, creates a virtual “agent” that learns through trial and error the particulars of a system to optimize how resources are managed. The second, called deep learning, uses neural networks, which are computer learning systems inspired by the human brain, to draw more abstract conclusions from each round of trial and error.

“Deep reinforcement learning has been successfully applied to many fields,” said one of the researchers, Albert Cabellos-Aparicio. “However, its application to computer networks is very recent. We hope that our paper helps kickstart deep-reinforcement learning in networking and that other researchers propose different and even better approaches.”

So far, the most advanced deep reinforcement learning algorithms have been able to optimize some resource allocation in OTNs, but they become stuck when they run into novel scenarios. The researchers worked to overcome this by varying the manner in which data are presented to the agent.

After putting the OTNs through 5,000 rounds of simulations, the deep reinforcement learning agent directed traffic with 30 percent greater efficiency than the current state-of-the-art algorithm.

One thing that surprised Cabellos-Aparicio and his team was how easily the new approach was able to learn about the networks after starting out with a blank slate.

“This means that without prior knowledge, a deep reinforcement learning agent can learn how to optimize a network autonomously,” Cabellos-Aparicio said. “This results in optimization strategies that outperform expert algorithms.”

Next, the group plans to apply their deep reinforcement strategies in combination with graph networks, an emerging field within artificial intelligence with the potential to transform scientific and industrial fields, such as computer networks, chemistry and logistics.