103907101 © Kittipong Jirasukhanont | Dreamstime.com
Camera Dreamstime L 103907101 642b0ca4b3d89

AI Vision Processor Tackles 4K Images

April 3, 2023
The Hailo-15 AI Vision Processor, which delivers 20 TOPS of neural-network performance, includes an application and DSP core along with an image signal processor.

Hailo’s Hailo-15 AI Vision Processor is built around the Hailo Neural Network (NN) core that can deliver up to 20 TOPS of performance (see figure). It’s designed to handle video streams up to 4k60 in real-time with the help of a vision subsystem and image signal processor (ISP).

The system-on-chip (SoC) isn’t just an AI accelerator. The application subsystem includes four 1.3-GHz Arm Cortex-A53 cores. A 32-bit LPDDR 4/4X memory interface runs at 4,266 Mtransfers/s.

The DSP vision-processing subsystem consists of a 700-MHz Vector DSP that can deliver 256 MACs and 350 GOPS. The ISP can handle up to a 12-Mpixel resolution with RGGB and RCCB color-filter-array (CFA) and wide-dynamic-range (WRD) support. In addition, it supports high dynamic range (HDR) and noise-reduction algorithms. The video system works with dual MIPI CSI inputs and a 24-bit digital video port (DVP).

Also in the mix are x4 PCI Express Gen 3 interfaces, 1-Gb Ethernet with RMII/RGMI interfaces, and USB 3.1 Gen2 host and device interfaces. The TrustZone security system supports secure boot and secure debugging. It also comes with a hardware-accelerated crypto library.

The chip is housed in a 15- × 15-mm FCBGA package. Operating temperature ranges from −40 to 85°C. A camera kit single-board computer is available.

The chip supports Yocto-based Linux. The Hailo Software Suite, data-flow compiler, and HailoRT toolkit are available from Hailo with optional Docker support.

About the Author

William G. Wong | Senior Content Director - Electronic Design and Microwaves & RF

I am Editor of Electronic Design focusing on embedded, software, and systems. As Senior Content Director, I also manage Microwaves & RF and I work with a great team of editors to provide engineers, programmers, developers and technical managers with interesting and useful articles and videos on a regular basis. Check out our free newsletters to see the latest content.

You can send press releases for new products for possible coverage on the website. I am also interested in receiving contributed articles for publishing on our website. Use our template and send to me along with a signed release form. 

Check out my blog, AltEmbedded on Electronic Design, as well as his latest articles on this site that are listed below. 

You can visit my social media via these links:

I earned a Bachelor of Electrical Engineering at the Georgia Institute of Technology and a Masters in Computer Science from Rutgers University. I still do a bit of programming using everything from C and C++ to Rust and Ada/SPARK. I do a bit of PHP programming for Drupal websites. I have posted a few Drupal modules.  

I still get a hand on software and electronic hardware. Some of this can be found on our Kit Close-Up video series. You can also see me on many of our TechXchange Talk videos. I am interested in a range of projects from robotics to artificial intelligence. 

Sponsored Recommendations

Comments

To join the conversation, and become an exclusive member of Electronic Design, create an account today!