As a new introduction to NVIDIA JetPack6, Jetson Platform Services provide a collection of pre-built and cloud-native software services to accelerate AI application development on NVIDIA Jetson Orin system-on-modules. NVIDIA distributes the power of AI, expanding its accessibility to a large audience of developers on NVIDIA Jetson and facilitating the rapid development of new innovative applications by using out-of-the-box solutions like object pattern recognition. Encompassing generative AI, such as natural language video search and querying, NVIDIA Jetson Platform Services significantly shortens the time to market for new applications and products.
While advantageous, underlying AI models and applications require continuous refinement and updates to improve their associated products while ensuring the highest levels of security. Device management and update capabilities must be scalable and capable of supporting large fleets of NVIDIA Jetson modules and their applications once deployed and in production.
To enable software installation, updates, management, and support across the Jetson device fleet and at scale – Mender, in collaboration with NVIDIA, published three critical use cases for NVIDIA developers. These resources provide a step-by-step breakdown for leveraging over-the-air (OTA) updates within the NVIDIA Jetson environment.
Use case #1: Managing operating system updates on Orin with JetPack 6
As a foundational layer, OS updates enable releasing new software for all parts of the software stack. Unlocking a robust full A/B update strategy with Mender means updating any software of the Jetson, including Platform Services and any applications, can be achieved without the risk of half-installed or bricked devices.
Get started: Enable robust A/B OTA updates by following the NVIDIA Jetson L4T Integration with full A/B system update tutorial.
Use case #2: Easy installation of Jetson Platform Services
Using Mender to install Jetson Platform Services saves significant time: deploying a single Mender Artifact brings up the whole stack. Existing in-field Jetsons on JetPack 6 can also be enhanced with Jetson Platform Services – at scale.
Get started: Follow the tutorial using an NVIDIA Jetson Orin with JetPack 6, Provisioning NVIDIA Jetson Platform Services with Mender, to quickly bring up Jetson Platform Services – even for those already in the field.
Use case #3: Diagnose and maintain Jetson Platform Services remotely
After your Jetson Platform Services-enabled products are in the field, leverage Mender to monitor and ensure they are all running successfully, diagnose any issues, and fix problems if needed.
The Mender Troubleshoot add-on contains several key features to resolve device issues in real-time securely. The Port forward feature can visualize Jetson Platform Services’ Grafana and VST dashboard on any remote device – without requiring any inbound port connectivity to the Jetson device. With the Remote terminal and File transfer features, you can diagnose any issue remotely, including viewing device logs, copying files locally for further analysis, and transferring diagnostics tools to the Jetson for advanced troubleshooting.
For fleet wide visibility and alerting, use the Mender Monitor add-on to ensure you are notified in case any system or application services have issues. Detect any issues before your customers do.
Mender combined with NVIDIA Jetson addresses the top three use cases developers encounter.
In many real-world AI applications – such as smart cameras in physical security, manufacturing, and automotive industries – the AI models or applications must run on edge IoT devices to support rapid response times and efficiency. In collaboration with NVIDIA, the Mender OTA infrastructure now enables full fleet management capabilities with Jetson Platform Services. The Mender and Jetson Platform Services combination allows AI models, applications, and devices to be easily, quickly, and securely updated and managed at scale in production.
