Neuromorphic NPU Sips Power to Handle Edge Machine-Learning Models
What you’ll learn:
- What are spiking neural networks (SNNs)?
- Why the Akido Pico neural processing unit (NPU) can use so little power to handle machine-learning models.
- Why neuromorphic computing is important to artificial intelligence.
Neuromorphic computing tries to more closely mimic the body’s neurological features in the form of spiking neural networks (SNNs), which take a different approach than the popular deep neural networks (DNNs). I talked with Steve Brightfield, Chief Marketing Officer at BrainChip, about the company's ultra-low-power Akido Pico neural processing unit (NPU).
The Akido Pico NPU is a co-processor designed to pair with a low-power microcontroller, targeting IoT/edge-computing devices that can run for months or years on a battery or energy-harvesting sources. We’re talking about microwatts of power for artificial-intelligence and machine-learning (AI/ML) accelerated applications. It can handle applications like speech and audio processing without resorting to the cloud.
Ultra-Low-Power Akido Pico NPU for Edge Computing
The Akido Pico is designed as a self-contained co-processor fed by the host (Fig. 1). It provides results to the host as a typical NPU would. The difference is how it handles the data. The next section provides a little more insight to neuromorphic computing and SNNs, but one of the key differences between SSNs and other DNNs is the use of spikes or “pulses.”
Essentially, the Akido Pico front end converts the usual parallel presentation of data into spikes that are fed into the processing system. These spikes note the changes between data provided to the NPU. There are some devices, such as Prophesee’s event-based Metavision image sensor, which could provide the type of data stream the system is capable of processing without conversion.
Regardless of the source data, the NPU will eventually kick out the model’s results based on the source data. The model is trained like a conventional DNN, using lots of data to generate the weights employed within the model.
BrainChip’s MetaTF development environment is designed for developers who have TensorFlow models (Fig. 2). The CNN2SNN tool converts convolutional neural networks (CNNs) to those that can be handled by the Akido platform.
What is Neuromorphic Computing and a Spiking Neural Network?
We haven’t yet looked at the underlying neuromorphic computing approach because developers are typically concerned with the AI/ML models. Spiking neural networks can’t handle all of the models, but neither can many other NPUs. For those that it’s able to handle, the models are developed and often trained using conventional tools.
CNN implementations build on layers that specify matrix computations. The inputs are massaged using the weights at each level generating output that’s processed by the next layer. The key here is that the computation for each layer is done all of the time and, computationally speaking, requires some heavy lifting. It’s why the work is typically done using an NPU or a GPU rather than a CPU. Optimizations that address sparsity, where weights are zero or very small, can accelerate computation without degrading the results.
SNNs are much different, although they use a similar layered structure (Fig. 3). The difference is that the pulses initiate computation, whereas a CNN always performs computations at each point within the model, making them more computationally intensive.
Scaling SNNs includes some of the techniques found in other neural-network implementations, including the use of different size weights. The optimizations must be considered with respect to the quality of the results.
Overall, SNNs fair very well compared to their counterparts for the types of applications that work with SNNs, e.g., stream processing, such as audio and video data. The low-latency and low-power aspects of this type of NPU suit it for standalone applications that need to conserve power.
Developers can take advantage of BrainChip’s software tools and chip simulator to test their applications.
