​Nature Electronics Paper – Professor Chen Xiaodong

We would like to extend our warmest congratulations to Professor Chen Xiaodong and the team on the publication of their article, entitled “Gesture recognition using a bioinspired learning architecture that integrates visual data with somatosensory data from stretchable sensors” in Nature Electronics. The research achievement has also been featured in various media.

Abstract
Gesture recognition using machine-learning methods is valuable in the development of advanced cybernetics, robotics and healthcare systems, and typically relies on images or videos. To improve recognition accuracy, such visual data can be combined with data from other sensors, but this approach, which is termed data fusion, is limited by the quality of the sensor data and the incompatibility of the datasets. Here, we report a bioinspired data fusion architecture that can perform human gesture recognition by integrating visual data with somatosensory data from skin-like stretchable strain sensors made from single-walled carbon nanotubes. The learning architecture uses a convolutional neural network for visual processing and then implements a sparse neural network for sensor data fusion and recognition at the feature level. Our approach can achieve a recognition accuracy of 100% and maintain recognition accuracy in non-ideal conditions where images are noisy and under- or over-exposed. We also show that our architecture can be used for robot navigation via hand gestures, with an error of 1.7% under normal illumination and 3.3% in the dark.

The paper can be found via this link: https://doi.org/10.1038/s41928-020-0422-z 

About the journal
Nature Electronics is a journal that publishes the best research from all areas of electronics, incorporating the work of scientists, engineers, and researchers in industry. Nature Electronics publishes both fundamental and applied research across all areas of electronics, from the study of novel phenomena and devices, to the design, construction, and wider application of electronic circuits. It also covers commercial and industrial aspects of electronics research.

Our heartiest congratulations to Professor Chen on his excellent achievement!

Media coverage:
The Engineer (UK)
Science Daily (US)
Techxplore (US)
Virtual Reality Magazine (GE)
Semiconductor Digest (US)
Technology Times (PK)
The National Tribune (AU)
Mirage News (AU)
Futurism (US)
Non perele (US)
Tekdeeps (US)
Technology Networks (US)
Scienmag (US)
Olhard Digital (BR)
New Electronics (UK)
Sohu news (CN)