Just How Computationally Complex Is a Single Brain Neuron

Long-time Slashdot reader Artem S. Tashkinov quotes Quanta magazine:Today, the most powerful artificial intelligence systems employ a type of machine learning called deep learning. Their algorithms learn by processing massive amounts of data through hidden layers of interconnected nodes, referred to as deep neural networks. As their name suggests, deep neural networks were inspired by the real neural networks in the brain, with the nodes modeled after real neuronsor, at least, after what neuroscientists knew about neurons back in the 1950s, when an influential neuron model called the perceptron was born. Since then, our understanding of the computational complexity of single neurons has dramatically expanded, so biological neurons are known to be more complex than artificial ones. But by how much' To find out, David Beniaguev, Idan Segev and Michael London, all at the Hebrew University of Jerusalem, trained an artificial deep neural network to mimic the computations of a simulated biological neuron. They showed that a deep neural network requires between five and eight layers of interconnected "neurons" to represent the complexity of one single biological neuron. Even the authors did not anticipate such complexity. "I thought it would be simpler and smaller," said Beniaguev. He expected that three or four layers would be enough to capture the computations performed within the cell. Timothy Lillicrap, who designs decision-making algorithms at the Google-owned AI company DeepMind, said the new result suggests that it might be necessary to rethink the old tradition of loosely comparing a neuron in the brain to a neuron in the context of machine learning. The paper's authors are now calling for changes in state-of-the-art deep network architecture in AI "to make it closer to how the brain works."Read more of this story at Slashdot.
Click here to read full news..