NVIDIA Jetson Orin: A breakthrough in industrial edge AI
03 January 2024
First released in August 2022, NVIDIA’s latest and greatest addition to the Jetson series marks a staggering leap forward in AI capabilities. The Jetson Orin, available in three distinct versions – that being Nano, NX and AGX – is a powerful series of system-on-chip-modules that is revolutionising Edge AI as we know it.
These powerful modules, ranging from 20 to 275 TOPS with a small form factor, can manage a remarkable number of AI operations per second. This makes them, in NVIDIA’s words, the world’s most powerful AI computers and a formidable option for a vast range of processing tasks with minimal energy consumption.
The Orin timeline
The timeline for the Jetson Orin dates back to March 2018, when the next-gen SoC (System-on-Chip) ‘Orin’ was first announced as being in development as the successor to the Jetson Xavier. The first device to be released in the Orin series was the Jetson AGX Orin Developer Kit, released in March 2022. That same year, the first standalone module of the series, the AGX Orin 32GB, was released in August 2022.
Next was the Orin NX 16GB module, released in late January 2023, followed not long after by the Orin Nano. Orin Nano was announced in September 2022 at the GPU Technology Conference 2022, and released in March 2023 in both 4GB and 8GB variants. In the same month, the 64GB variant of the AGX Orin and the 8GB variant of the Orin NX were also released.
Finally, the AGX Orin Industrial module was announced at COMPUTEX 2023, and became available in May 2023.
Powerful AI operations
Specifications for each Orin module
TOPS, or Tera Operations per Second, serves as a pivotal metric in assessing the processing power of artificial intelligence and digital signal tasks. This metric quantifies the number of trillion operations a system can execute within a second, offering a measure of the processing speed and efficiency for different devices.
TOPS is especially crucial in evaluating the performance of neural networks, where intricate calculations are vital. In the context of high-performance computing, such as edge devices or dedicated AI processors, TOPS clearly indicates a system’s capacity to handle complex tasks swiftly.
The relevance of TOPS as a benchmark in today’s industrial activities highlights its significance in shaping the landscape of modern computing, and the Orin serves as proof that advancements are always being made to improve the computational power of our modern technology.
Jetson Xavier: How does it compare?
The Orin series of computers succeeds the Xavier series with a substantial improvement in its specs. For example, comparing the Jetson Xavier NX 16GB to the Orin NX 16GB, the Orin can achieve 79 trillion more operations per second with the same amount of memory. Additionally, power consumption has been optimised, as evidenced by the 20W max consumption from the Xavier model, compared to the 25W max consumption from the Orin, despite achieving five times the TOPS.
The AGX Orin 64GB model, the most powerful from NVIDIA’s modules, improves substantially over the Xavier, with 275 TOPS – eight times more powerful than the AGX Xavier 64GB model.
For a detailed comparison of the Xavier specs compared to the Orin, see the table below.
Orin for industrial AI applications
The AGX Orin Industrial module is especially suited for settings with harsh environmental factors, with the computational power required for advanced artificial intelligence tasks. This model comes with the same improved TOPS to handle trillions of AI operations per second as the other Orin models, along with an extended temperature range, enhanced shock and vibration resistance, and support for Error Correction Code (ECC) memory. This makes it durable for environments where common areas of failure, such as those caused by extreme heat, dust, and shock, can be addressed.
Edge AI computers, such as Advantech’s MIC-711-OX which features NVIDIA’s Jetson Orin NX 16GB module, can be used for a range of uses in industries that are innovating and adapting every day. This includes manufacturing, where AI can be used to detect defects during quality inspections, or in driverless vehicles and AGVs (Automated Guided Vehicles).
Additionally, industrial AI is used in the railway industry to offer innovative solutions that enhance performance in areas such as efficiency, safety, and daily operations. Predictive maintenance can be optimised using AI, which analyses historical data to predict when maintenance on the rails and overhead cables is likely to be required, making it a proactive process. AI can also vastly improve safety by identifying when trespassers and foreign objects are on the tracks or anticipate a landslip due to changes in the wayside, which can then prompt dynamic action to prevent incidents. Additionally, it is currently being used to track ticket evaders on the railway and to detect overcrowding inside train carriages, allowing train operating companies (TOCs) to estimate passenger numbers more accurately.
A detailed comparison of Xavier specifications compared to the Orin
AI inference with industry insight
As a provider of powerful and innovative solutions such as NVIDIA’s Orin series, Impulse Embedded empowers the industrial sector in the UK with the latest artificial intelligence processing capabilities. With a proven track record in the industry, Impulse brings a wealth of experience in providing robust embedded computing solutions that are tailored to diverse industrial needs.
Whether deployed in manufacturing, automation, rail or other industries, devices from Impulse represent the technological advancement that allows businesses to thrive in an era where AI is becoming increasingly prevalent.
For more information regarding Edge AI computers, please click here, or contact Impulse about your AI project.
Contact Details and Archive...