Falling for AI at the Edge

Aug. 2, 2022

The machine-learning support from Synaptics' Katana SoC can visually detect actions like falling.

Check out more Sensors Converge coverage. This video is also part of the TechXchange: AI on the Edge.

Synaptics' Katana-based edge artificial-intelligence (AI), low-power SoC is powerful enough to analyze a video stream with machine-learning (ML) models that can visually detect actions like falling. Ananda Roy highlights this feature in the video.

The demonstration was done using Synaptics evaluation kit (Fig. 1). The platform, based on the Katana SoC, adds audio input via two microphones and a Himax QVGA video module along with an ambient-light sensor and accelerometer. The Wi-Fi/Bluetooth module provides wireless connectivity. There's even an OLED display for immediate user feedback.

1. The Katana low-power edge AI SoC is at the heart of the video sensor evaluation platform.

Katana is a multicore SoC with a dual DSP to handle ML models in real-time (Fig. 2). It also manages audio and video data. A Cortex-M3 core provides system-management support.

2. The dual-code DSP provides heavy-lifting support for machine-learning models.

The SyNAP toolkit is a full-stack, open-source platform that supports ONNX and AI frameworks like TensorFlow and TensorFlow Lite.

Links

About the Author

William G. Wong | Senior Content Director - Electronic Design and Microwaves & RF

I am Editor of Electronic Design focusing on embedded, software, and systems. As Senior Content Director, I also manage Microwaves & RF and I work with a great team of editors to provide engineers, programmers, developers and technical managers with interesting and useful articles and videos on a regular basis. Check out our free newsletters to see the latest content.

You can send press releases for new products for possible coverage on the website. I am also interested in receiving contributed articles for publishing on our website. Use our template and send to me along with a signed release form.

Check out my blog, AltEmbedded on Electronic Design, as well as his latest articles on this site that are listed below.

You can visit my social media via these links:

I earned a Bachelor of Electrical Engineering at the Georgia Institute of Technology and a Masters in Computer Science from Rutgers University. I still do a bit of programming using everything from C and C++ to Rust and Ada/SPARK. I do a bit of PHP programming for Drupal websites. I have posted a few Drupal modules.

I still get a hand on software and electronic hardware. Some of this can be found on our Kit Close-Up video series. You can also see me on many of our TechXchange Talk videos. I am interested in a range of projects from robotics to artificial intelligence.