Wednesday, September 24, 2025

Nvidia Jetson ORIN NANO AI/ML Developer Kit

 I finally got my order of the long backordered - Nvidia Jetson ORIN NANO AI/ML Developer Kit. I will be testing and reporting on AI/ML/LLM benchmarks and projects made using this.

I still own the Jetson Nano kit as well.

The NVIDIA Jetson Orin Nano is an edge AI computer available in an 8GB and a 4GB module, featuring an NVIDIA Ampere architecture GPU with 1024 CUDA cores (8GB version) and a 6-core Arm® Cortex®-A78AE CPU. It offers up to 67 INT8 TOPS of AI performance (8GB module), is equipped with 8GB (or 4GB) of LPDDR5 memory, and supports external storage via microSD and NVMe. The device is designed for edge AI applications, offering a balance of performance, power efficiency (7W-15W for the 8GB module), and a compact form factor. 

Here's a breakdown of the key specs for the 8GB Jetson Orin Nano module:

GPU 

Architecture: NVIDIA Ampere

CUDA Cores: 1024

Tensor Cores: 32

AI Performance: Up to 40 INT8 TOPS (dense) / 67 INT8 TOPS (sparse)

CPU

Cores: 6-core Arm® Cortex®-A78AE v8.2 64-bit 

Cache: 1.5MB L2 + 4MB L3 

Clock Speed: Up to 1.5 GHz (original) or 1.7 GHz (Super version) 

Memory 

Capacity: 8GB

Type: 128-bit LPDDR5

Bandwidth: 68 GB/s (original) or 102 GB/s (Super version)

Storage 

Supports microSD card for the base OS

Supports external NVMe SSDs via M.2 Key M slot

Power 

Power Modes: 7W, 15W (and a new 25W "Super" mode)

Key Features

Size: Compact, ~69.6mm x 45mm 

Connectivity: USB ports, GbE, HDMI/DP output, and multiple I/O options 

Applications: Ideal for edge AI applications, robotics, smart vision systems, and more 

Picture:







Picture - Bootup, and firmware updating. I used a 128Gb MicroSD card and downloaded the latest firmware from this link - click here.







Unboxing video:




Large Language Models explained briefly

 Great video which explains LLM simply, by 3Blue1Brown youtube channel which explains maths using animation. atin math