Motherboard Brings AI and SmartNIC Performance to the Industrial Edge
Check out more coverage from GTC Fall 2022. This is also part of the TechXchange: Smart and Secure Storage
What you’ll learn
- What is the IGX Orin platform?
- Where will the IGX Orin motherboard be used?
The Jetson AGX Orin module developed by NVIDIA requires a carrier board to operate. This has typically been a compact motherboard designed for embedded systems. They’re available from a variety of vendors, and the backward compatibility with earlier Jetson AGX platforms enables these boards to host the latest incarnation.
The NVIDIA IGX Orin platform is a standard-size motherboard, allowing it to fit into standard PC cases or in applications designed around this standard form factor. The motherboard comes with a Jetson AGX Orin module; thus, it can host a range of machine-learning applications based on the company’s software libraries and framework stacks (see figure). The module can deliver 275 TOPS of AI performance.
Because the system is designed for security and performance, it can be used in applications such as industrial control and medical applications, where AI and security are two top priorities for developers.
The system also is built for high network throughput by including NVIDIA’s ConnectX-7 SmartNIC. It includes accelerated switch and packet processing technology that reduce CPU overhead. RDMA over Converged Ethernet (RoCE) is part of that support, providing remote direct-memory access (RDMA) services for latency-sensitive applications.
Further support comes from the Data Plane Development Kit (DPDK) and its own secure boot with in-hardware root of trust. This is the same technology used on the company’s PCI Express SmartNIC cards.
The IGX features a board management controller (BMC) and matching software stack for remote system management. It handles software updates, while the secure-boot controller provides an external root of trust. The dedicated safety monitor supports a real-time operating system (RTOS) with built-in safety monitoring software.
This isn’t a reference platform but rather a long-term platform with a guaranteed 10-year support for the IGX software stack. This includes a Linux board-support package with documentation relating to industrial and medical certification.
Check out more coverage from GTC Fall 2022. This is also part of the TechXchange: Smart and Secure Storage