A Neural Network Framework for Small Microcontrollers

Abstract

This paper presents a lightweight and compact library designed to perform convolutional neural network inference for microcontrollers with severe hardware limitations. A review of similar open source libraries is included and an experiment is developed to compare their performance on different microcontrollers. The proposed library shows at least a 9 times improvement over the implementation of Google Tensorflow Lite with respect to memory usage and inference time.