<img src="https://spectrum.ieee.org/media-library/close-up-of-tdk-s-prototype-of-an-analog-reservoir-ai-chip.jpg?id=62299641&width=1245&height=700&coordinates=0%2C187%2C0%2C188"/> Rock-paper-scissors is often a game of psychology, reverse psychology, reverse-reverse psychology, and chance. But what if a computer could understand you well enough to win every time? A team at Hokkaido University and the <a href="https://www.tdk.com/en/index.html" target="_blank">TDK Corp.</a> (of cassette-tape fame), both based in Japan, has designed a chip that can do just that.Okay, the chip does not read your mind. It uses an acceleration sensor placed on your thumb to measure your motion and eventually earns which motions represent paper, scissors, or rock. The amazing thing is, once it’s trained on your particular gestures, the chip can run the calculation predicting what you’ll do in the time it takes you to say “shoot,” allowing it to defeat you in real time.The technique behind this feat is called reservoir computing, which is a machine learning method that uses a complex dynamical system to extract meaningful features from time-series data. The idea of reservoir computing goes as far back as the <a href="https://direct.mit.edu/jocn/article-abstract/7/3/311/3172/A-Model-of-Corticostriatal-Plasticity-for-Learning?redirectedFrom=fulltext" rel="noopener noreferrer" target="_blank">1990s</a>. With the growth of artificial intelligence, there has been renewed interest in reservoir computing due to its comparatively low power requirements and its potential for fast training and inference.The research team saw power consumption as a target, says <a href="https://www.linkedin.com/in/tomoyuki-sasaki-98284b193/?originalSubdomain=jp" rel="noopener noreferrer" target="_blank">Tomoyuki Sasaki</a>, section head and senior manager at TDK, who worked on the device. “The second target is the latency issue. In the case of the edge AI, latency is a huge problem.”To minimize the energy and latency of their setup, the team developed a CMOS hardware implementation of an analog reservoir-computing circuit. The team presented their demo at the <a href="https://www.ceatec.com/en/" rel="noopener noreferrer" target="_blank">Combined Exhibition of Advanced Technologies</a> conference in Chiba, Japan, in October and are presenting their paper at the <a href="https://rebootingcomp.github.io/icrc2025/#registration" rel="noopener noreferrer" target="_blank">International Conference on Rebooting Computing</a> in San Diego this week.<h2>What is reservoir computing?</h2>A reservoir computer is best understood in contrast to traditional <a href="https://spectrum.ieee.org/what-is-deep-learning/neural-network" target="_self">neural networks</a>, the basic architecture underlying much of AI today.A neural network consists of artificial neurons, arranged in layers. Each layer can be thought of as a column of neurons, with each neuron in a column connecting to all the neurons in the next column via weighted artificial synapses. Data enters into the first column and propagates from left to right, layer by layer, until the final column.During training, the output of the final layer is compared to the correct answer, and this information is used to adjust the weights in all the synapses, this time working backward, layer by layer, in a process called <a href="https://www.ibm.com/think/topics/backpropagation" target="_blank">backpropagation</a>.This setup has two important features. First, the data travels only one way—forward. There are no loops. Second, all of the weights connecting any pair of neurons are adjusted during the training process. This architecture has proven extremely effective and flexible, but it is also costly; adjusting what sometimes ends up being billions of weights takes both time and power.Reservoir computing is also built with artificial neurons and synapses, but they are arranged in a fundamentally different way. First, there are no layers—the neurons are connected to other neurons in a complicated, weblike way with plenty of loops. This imbues the network with a type of memory, where a particular input can keep coming back around.Second, the connections within the reservoir are fixed. The data enters the reservoir, propagates through its complex structure, and then is connected by a set of final synapses to the output. It’s only this last set of synapses, with their weights, that actually gets adjusted during training. This approach greatly simplifies the training process, and eliminates the need for backpropagation altogether.Given that the reservoir is fixed, and the only part that’s trained is a final “translation” layer from the reservoir to the desired output, it may seem like a miracle that these networks can be useful at all. And yet, for certain tasks, they have proved to be extremely effective.“They’re by no means a blanket best model to use in the machine learning toolbox,” says <a href="https://www.cs.ucsb.edu/people/faculty/sanjukta-krishnagopal" rel="noopener noreferrer" target="_blank">Sanjukta Krishnagopal</a>, assistant professor of computer science at the University of California, Santa Barbara, who was not involved in the work. But for predicting the time evolution of things that behave chaotically, such as for example, the weather, they are the right tool for the job. “This is where reservoir computing shines.”The reason is that the reservoir itself is a bit chaotic. “Your reservoir is usually operating at what’s called the edge of chaos, which means it can represent a large number of possible states, very simply, with a very small neural network,” Krishnagopal says. <h2>A physical-reservoir computer</h2>The artificial synapses inside the reservoir are fixed, and backpropagation does not need to happen. This leaves a lot of freedom in how the reservoir is implemented. To build physical reservoirs, people have used a wide variety of mediums, including <a href="https://www.nature.com/articles/s41467-024-55172-3" rel="noopener noreferrer" target="_blank">light</a>, <a href="https://spectrum.ieee.org/artificial-intelligence-on-a-mems-device-brings-neuromorphic-computing-to-the-edge" target="_self">MEMS devices</a>, and my personal favorite, <a href="https://link.springer.com/chapter/10.1007/978-3-540-39432-7_63" rel="noopener noreferrer" target="_blank">literal buckets of water</a>.However, the team at Hokkaido and TDK wanted to create a CMOS-compatible chip that could be used in edge devices. To implement an artificial neuron, the team designed an analog circuit node. Each node is made up of three components: a nonlinear resistor, a memory element based on MOS capacitors, and a buffer amplifier. Their chip consisted of four cores, each made up of 121 such nodes.Wiring up the nodes to connect with each other in the complex recurring patterns required for a reservoir is difficult. To cut down on the complexity, the team decided on a so-called simple cycle reservoir, with all the nodes connected in one big loop. <a href="https://dl.acm.org/doi/abs/10.5555/3722577.3722735" rel="noopener noreferrer" target="_blank">Prior work</a> has suggested that even this relatively simple configuration is capable of modeling a wide range of complicated dynamics.Using this design, the team was able to build a chip that consumed only 20 microwatts of power per core, or 80 µW of power total—significantly less than other CMOS-compatible physical-reservoir computing designs, the authors say.<h2>Predicting the future</h2>Aside from defeating humans at rock-paper-scissors, the reservoir-computing chip can predict the next step in a time series in many different domains. “If what occurs today is affected by yesterday’s data, or other past data, it can predict the result,” Sasaki says.The team demonstrated the chip’s abilities on several tasks, including predicting the behavior of a well-known chaotic system known as a <a href="https://en.wikipedia.org/wiki/Logistic_map" target="_blank">logistic map</a>. The team also used the device on the archetypal real-world example of chaos: the weather. For both test cases, the chip was able to predict the next step with remarkable accuracy.The precision of the prediction is not the main selling point, however. The extremely low power use and low latency offered by the chip could enable a new set of applications, such as real-time learning on wearables and other edge devices.“I think the prediction is actually the same as the present technology,” Sasaki says. “However, the power consumption, the operation speed, is maybe 10 times better than the present AI technology. That is a big difference.”

طورت مجموعة من جامعة هوكايدو وشركة TDK شريحة مبتكرة يمكنها التنبؤ بالحركة التالية للاعب في لعبة حجر-ورقة-مقص باستخدام مستشعر تسارع لتحليل حركات الإبهام. بمجرد تدريبها على إيماءات فرد معين، يمكن للشريحة حساب وتوقع اختيار اللاعب في الوقت الحقيقي، مما يسمح لها بالفوز في كل مرة.

Un equipo de la Universidad de Hokkaido y TDK Corp. ha desarrollado un chip innovador que puede predecir el próximo movimiento de un jugador en piedra-papel-tijera utilizando un sensor de aceleración para analizar los movimientos del pulgar. Una vez entrenado en los gestos de un individuo, el chip puede calcular y anticipar la elección del jugador en tiempo real, permitiéndole ganar cada vez.

Une équipe de l'Université de Hokkaido et de TDK Corp. a développé une puce innovante capable de prédire le prochain mouvement d'un joueur au jeu pierre-papier-ciseaux en utilisant un capteur d'accélération pour analyser les mouvements du pouce. Une fois entraînée sur les gestes d'un individu, la puce peut calculer et anticiper le choix du joueur en temps réel, lui permettant ainsi de gagner à chaque fois.

A team from Hokkaido University and TDK Corp. has developed an innovative chip that can predict a player's next move in rock-paper-scissors by using an acceleration sensor to analyze thumb movements. Once trained on an individual's gestures, the chip can calculate and anticipate the player's choice in real time, effectively allowing it to win every game.