Tuesday, December 17th 2024
NVIDIA Unveils New Jetson Orin Nano Super Developer Kit
NVIDIA is taking the wraps off a new compact generative AI supercomputer, offering increased performance at a lower price with a software upgrade. The new NVIDIA Jetson Orin Nano Super Developer Kit, which fits in the palm of a hand, provides everyone from commercial AI developers to hobbyists and students, gains in generative AI capabilities and performance. And the price is now $249, down from $499.
Available today, it delivers as much as a 1.7x leap in generative AI inference performance, a 70% increase in performance to 67 INT8 TOPS, and a 50% increase in memory bandwidth to 102 GB/s compared with its predecessor. Whether creating LLM chatbots based on retrieval-augmented generation, building a visual AI agent, or deploying AI-based robots, the Jetson Orin Nano Super is an ideal solution to fetch.
The Gift That Keeps on Giving
The software updates available to the new Jetson Orin Nano Super will also boost generative AI performance for those who already own the Jetson Orin Nano Developer Kit.
Jetson Orin Nano Super is suited for those interested in developing skills in generative AI, robotics or computer vision. As the AI world is moving from task-specific models into foundation models, it also provides an accessible platform to transform ideas into reality.
Powerful Performance With Super for Generative AI
The enhanced performance of the Jetson Orin Nano Super delivers gains for all popular generative AI models and transformer-based computer vision.
The developer kit consists of a Jetson Orin Nano 8 GB system-on-module (SoM) and a reference carrier board, providing an ideal platform for prototyping edge AI applications.
The SoM features an NVIDIA Ampere architecture GPU with tensor cores and a 6-core Arm CPU, facilitating multiple concurrent AI application pipelines and high-performance inference. It can support up to four cameras, offering higher resolution and frame rates than previous versions.
Extensive Generative AI Software Ecosystem and Community
Generative AI is evolving quickly. The NVIDIA Jetson AI lab offers immediate support for those cutting-edge models from the open-source community and provides easy-to-use tutorials. Developers can also get extensive support from the broader Jetson community and inspiration from projects created by developers.
Jetson runs NVIDIA AI software including NVIDIA Isaac for robotics, NVIDIA Metropolis for vision AI and NVIDIA Holoscan for sensor processing. Development time can be reduced with NVIDIA Omniverse Replicator for synthetic data generation and NVIDIA TAO Toolkit for fine-tuning pretrained AI models from the NGC catalog.
Jetson ecosystem partners offer additional AI and system software, developer tools and custom software development. They can also help with cameras and other sensors, as well as carrier boards and design services for product solutions.
Boosting Jetson Orin Performance for All With Super Mode
The software updates to boost 1.7X generative AI performance will also be available to the Jetson Orin NX and Orin Nano series of systems on modules.
Existing Jetson Orin Nano Developer Kit owners can upgrade the JetPack SDK to unlock boosted performance today.
Source:
NVIDIA
Available today, it delivers as much as a 1.7x leap in generative AI inference performance, a 70% increase in performance to 67 INT8 TOPS, and a 50% increase in memory bandwidth to 102 GB/s compared with its predecessor. Whether creating LLM chatbots based on retrieval-augmented generation, building a visual AI agent, or deploying AI-based robots, the Jetson Orin Nano Super is an ideal solution to fetch.
The software updates available to the new Jetson Orin Nano Super will also boost generative AI performance for those who already own the Jetson Orin Nano Developer Kit.
Jetson Orin Nano Super is suited for those interested in developing skills in generative AI, robotics or computer vision. As the AI world is moving from task-specific models into foundation models, it also provides an accessible platform to transform ideas into reality.
Powerful Performance With Super for Generative AI
The enhanced performance of the Jetson Orin Nano Super delivers gains for all popular generative AI models and transformer-based computer vision.
The developer kit consists of a Jetson Orin Nano 8 GB system-on-module (SoM) and a reference carrier board, providing an ideal platform for prototyping edge AI applications.
The SoM features an NVIDIA Ampere architecture GPU with tensor cores and a 6-core Arm CPU, facilitating multiple concurrent AI application pipelines and high-performance inference. It can support up to four cameras, offering higher resolution and frame rates than previous versions.
Extensive Generative AI Software Ecosystem and Community
Generative AI is evolving quickly. The NVIDIA Jetson AI lab offers immediate support for those cutting-edge models from the open-source community and provides easy-to-use tutorials. Developers can also get extensive support from the broader Jetson community and inspiration from projects created by developers.
Jetson runs NVIDIA AI software including NVIDIA Isaac for robotics, NVIDIA Metropolis for vision AI and NVIDIA Holoscan for sensor processing. Development time can be reduced with NVIDIA Omniverse Replicator for synthetic data generation and NVIDIA TAO Toolkit for fine-tuning pretrained AI models from the NGC catalog.
Jetson ecosystem partners offer additional AI and system software, developer tools and custom software development. They can also help with cameras and other sensors, as well as carrier boards and design services for product solutions.
Boosting Jetson Orin Performance for All With Super Mode
The software updates to boost 1.7X generative AI performance will also be available to the Jetson Orin NX and Orin Nano series of systems on modules.
Existing Jetson Orin Nano Developer Kit owners can upgrade the JetPack SDK to unlock boosted performance today.
17 Comments on NVIDIA Unveils New Jetson Orin Nano Super Developer Kit
And why on God's Green Earth, does that piece of shite CEO think anyone cares about his signature being on the box?
www.anandtech.com/show/16114/arm-announces-cortexa78ae-malig78ae-and-malic71ae-autonomous-system-ips
Besides, my understanding was that Nintendo had gone with MTK this time around, but possibly an Nvidia GPU.
Nintendo Switch 2 to Feature NVIDIA Ampere GPU with DLSS | TechPowerUp
But this rumor is over a year old. More recent articles talk about Nvidia DLSS and Ampere.
Alleged Nintendo Switch 2 design leaks out: 8-inch screen and 12GB LPDDR5X-7500 memory - VideoCardz.com
Since there are no later SoC's from Nvidia and Orin uses Ampere, what else could it be?
A 7-25 W chip would be devastating for Nintendo in terms of battery life, we already know how mediocre the Steamdeck is with a 4-15 W SoC.
It will hopefully, for Nintendo's sake, be a custom SoC made specifically for them, that offers decent battery life.There are multiple kinds of "AI", this is used for edge devices, for example something in your home or in a "robot" or some other smaller applications that does on-device processing.
What you're thinking of is LLM, whereas this is more for ML.
Now if it included a signed jacket, I might buy one, you know, just because !
The A78 is pretty much a mobile-focused core, the AE variant just adds some extra security stuff but the core design itself is still pretty much the same.This is not meant to replace a GPU, but rather be used in embedded/low power scenarios. I can train a model with my 3090s and use that same model for inference in my Orin without any code changes (since both have the same architecture), and deploy it with a pack of batteries anywhere.The current switch uses a 10~15W chip, and the original Orin is able to fit within this budget at ease while delivering way more performance.
FWIW, I have both the original Jetson Nano (with a Maxwell GPU, the same SoC of the current switch), and a Orin Nano, the performance difference is mind blowing at a similar power envelope.