Jahr | 2020 |
Autor(en) | Johannes Weis, Philipp Spilger, Sebastian Billaudelle, Yannik Stradmann, Arne Emmel, Eric Müller, Oliver Breitwieser, Andreas Grübl, Joscha Ilmberger, Vitali Karasenko, Mitja Kleider, Christian Mauch, Korbinian Schreiber, Johannes Schemmel |
Titel | Inference with Artificial Neural Networks on Analog Neuromorphic Hardware |
KIP-Nummer | HD-KIP 20-104 |
KIP-Gruppe(n) | F9 |
Dokumentart | Paper |
Keywords (angezeigt) | Analog Accelerator, Neural Network Processor, Neuromorphic Hardware, Convolutional Neural Networks, Machine Learning, In-memory Computing, MNIST |
Quelle | Communications in Computer and Information Science, vol 1325 (2020), pp 201-212 |
doi | https://doi.org/10.1007/978-3-030-66770-2_15 |
Abstract (en) | The neuromorphic BrainScaleS-2 ASIC comprises mixed-signal neurons and synapse circuits as well as two versatile digital microprocessors. Primarily designed to emulate spiking neural networks, the system can also operate in a vector-matrix multiplication and accumulation mode for artificial neural networks. Analog multiplication is carried out in the synapse circuits, while the results are accumulated on the neurons' membrane capacitors. Designed as an analog, in-memory computing device, it promises high energy efficiency. Fixed-pattern noise and trial-to-trial variations, however, require the implemented networks to cope with a certain level of perturbations. Further limitations are imposed by the digital resolution of the input values (5 bit), matrix weights (6 bit) and resulting neuron activations (8 bit). In this paper, we discuss BrainScaleS-2 as an analog inference accelerator and present calibration as well as optimization strategies, highlighting the advantages of training with hardware in the loop. Among other benchmarks, we classify the MNIST handwritten digits dataset using a two-dimensional convolution and two dense layers. We reach 98.0% test accuracy, closely matching the performance of the same network evaluated in software. |
bibtex | @inproceedings{weis2020inference, author = {Weis, Johannes and Spilger, Philipp and Billaudelle, Sebastian and Stradmann, Yannik and Emmel, Arne and M{\"u}ller, Eric and Breitwieser, Oliver and Gr{\"u}bl, Andreas and Ilmberger, Joscha and Karasenko, Vitali and Kleider, Mitja and Mauch, Christian and Schreiber, Korbinian and Schemmel, Johannes}, title = {Inference with Artificial Neural Networks on Analog Neuromorphic Hardware}, booktitle = {IoT Streams for Data-Driven Predictive Maintenance and IoT, Edge, and Mobile for Embedded Machine Learning}, year = {2020}, volume = {1325}, pages = {201--212}, publisher = {Springer International Publishing} } |
URL | Springer Link |
URL | arXiv |