TY - JOUR
T1 - Implementation of Artificial Neural Networks Using Magnetoresistive Random-Access Memory-Based Stochastic Computing Units
AU - Shao, Yixin
AU - Sinaga, Sisilia Lamsari
AU - Sunmola, Idris O.
AU - Borland, Andrew S.
AU - Carey, Matthew J.
AU - Katine, Jordan A.
AU - Lopez-Dominguez, Victor
AU - Amiri, Pedram Khalili
N1 - Funding Information:
This work was supported by the National Science Foundation, Division of Industrial Innovation and Partnerships under Grant NSF IIP-1919109.
Publisher Copyright:
© 2010-2012 IEEE.
PY - 2021
Y1 - 2021
N2 - Hardware implementation of artificial neural networks (ANNs) using conventional binary arithmetic units requires large area and energy, due to the massive multiplication and addition operations in the inference process, limiting their use in edge computing and emerging Internet of Things (IoT) systems. Stochastic computing (SC), where the probability of 1s and 0s in a randomly generated bit-stream is used to represent a decimal number, has been devised as an alternative for compact and low-energy arithmetic hardware, due to its ability to implement basic arithmetic operations using far fewer logic gates than binary operations. To realize SC in hardware, however, tunable true random-number generators (TRNGs) are needed, which cannot be efficiently realized using existing complementary metal-oxide-semiconductor complementary metal-oxide-semiconductor (CMOS) technology. In this letter, we address this challenge by using magnetic tunnel junctions (MTJs) as TRNGs, the stochasticity of which can be tuned by an electric current via spin-transfer torque. We demonstrate the implementation of ANNs with SC units, using stochastic bit-streams experimentally generated by a series of 50 nm perpendicular MTJs. The numerical value (1 to 0 ratio) of the bit-streams is tuned by the current through the MTJs via spin-transfer torque with an ultralow current of <5 μA (= 0.25 MA⋅cm-2). The MTJ-based SC-ANN achieves 95% accuracy for handwritten digit recognition on the MNIST database. MRAM-based SC-ANNs provide a promising solution for ultra-low-power machine learning in edge, mobile, and IoT devices.
AB - Hardware implementation of artificial neural networks (ANNs) using conventional binary arithmetic units requires large area and energy, due to the massive multiplication and addition operations in the inference process, limiting their use in edge computing and emerging Internet of Things (IoT) systems. Stochastic computing (SC), where the probability of 1s and 0s in a randomly generated bit-stream is used to represent a decimal number, has been devised as an alternative for compact and low-energy arithmetic hardware, due to its ability to implement basic arithmetic operations using far fewer logic gates than binary operations. To realize SC in hardware, however, tunable true random-number generators (TRNGs) are needed, which cannot be efficiently realized using existing complementary metal-oxide-semiconductor complementary metal-oxide-semiconductor (CMOS) technology. In this letter, we address this challenge by using magnetic tunnel junctions (MTJs) as TRNGs, the stochasticity of which can be tuned by an electric current via spin-transfer torque. We demonstrate the implementation of ANNs with SC units, using stochastic bit-streams experimentally generated by a series of 50 nm perpendicular MTJs. The numerical value (1 to 0 ratio) of the bit-streams is tuned by the current through the MTJs via spin-transfer torque with an ultralow current of <5 μA (= 0.25 MA⋅cm-2). The MTJ-based SC-ANN achieves 95% accuracy for handwritten digit recognition on the MNIST database. MRAM-based SC-ANNs provide a promising solution for ultra-low-power machine learning in edge, mobile, and IoT devices.
KW - Spin electronics
KW - artificial neural network
KW - magnetoresistive random-access memory
KW - stochastic computing
UR - http://www.scopus.com/inward/record.url?scp=85103891093&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85103891093&partnerID=8YFLogxK
U2 - 10.1109/LMAG.2021.3071084
DO - 10.1109/LMAG.2021.3071084
M3 - Article
AN - SCOPUS:85103891093
VL - 12
JO - IEEE Magnetics Letters
JF - IEEE Magnetics Letters
SN - 1949-307X
M1 - 9395199
ER -