|
|
|
|
@@ -1,6 +1,6 @@
|
|
|
|
|
# DeepStream-Yolo
|
|
|
|
|
|
|
|
|
|
NVIDIA DeepStream SDK 6.1.1 / 6.1 / 6.0.1 / 6.0 configuration for YOLO models
|
|
|
|
|
NVIDIA DeepStream SDK 6.2 / 6.1.1 / 6.1 / 6.0.1 / 6.0 configuration for YOLO models
|
|
|
|
|
|
|
|
|
|
### Future updates
|
|
|
|
|
|
|
|
|
|
@@ -58,13 +58,23 @@ NVIDIA DeepStream SDK 6.1.1 / 6.1 / 6.0.1 / 6.0 configuration for YOLO models
|
|
|
|
|
|
|
|
|
|
### Requirements
|
|
|
|
|
|
|
|
|
|
#### DeepStream 6.2 on x86 platform
|
|
|
|
|
|
|
|
|
|
* [Ubuntu 20.04](https://releases.ubuntu.com/20.04/)
|
|
|
|
|
* [CUDA 11.8](https://developer.nvidia.com/cuda-11-8-0-download-archive?target_os=Linux&target_arch=x86_64&Distribution=Ubuntu&target_version=20.04&target_type=runfile_local)
|
|
|
|
|
* [TensorRT 8.5 GA Update 1 (8.5.2.2)](https://developer.nvidia.com/nvidia-tensorrt-8x-download)
|
|
|
|
|
* [NVIDIA Driver 525.85.12 (Data center / Tesla series) / 525.105.17 (TITAN, GeForce RTX / GTX series and RTX / Quadro series)](https://www.nvidia.com.br/Download/index.aspx)
|
|
|
|
|
* [NVIDIA DeepStream SDK 6.2](https://developer.nvidia.com/deepstream-getting-started)
|
|
|
|
|
* [GStreamer 1.16.3](https://gstreamer.freedesktop.org/)
|
|
|
|
|
* [DeepStream-Yolo](https://github.com/marcoslucianops/DeepStream-Yolo)
|
|
|
|
|
|
|
|
|
|
#### DeepStream 6.1.1 on x86 platform
|
|
|
|
|
|
|
|
|
|
* [Ubuntu 20.04](https://releases.ubuntu.com/20.04/)
|
|
|
|
|
* [CUDA 11.7 Update 1](https://developer.nvidia.com/cuda-11-7-1-download-archive?target_os=Linux&target_arch=x86_64&Distribution=Ubuntu&target_version=20.04&target_type=runfile_local)
|
|
|
|
|
* [TensorRT 8.4 GA (8.4.1.5)](https://developer.nvidia.com/nvidia-tensorrt-8x-download)
|
|
|
|
|
* [NVIDIA Driver 515.65.01](https://www.nvidia.com.br/Download/index.aspx)
|
|
|
|
|
* [NVIDIA DeepStream SDK 6.1.1](https://developer.nvidia.com/deepstream-getting-started)
|
|
|
|
|
* [NVIDIA DeepStream SDK 6.1.1](https://developer.nvidia.com/deepstream-sdk-download-tesla-archived)
|
|
|
|
|
* [GStreamer 1.16.2](https://gstreamer.freedesktop.org/)
|
|
|
|
|
* [DeepStream-Yolo](https://github.com/marcoslucianops/DeepStream-Yolo)
|
|
|
|
|
|
|
|
|
|
@@ -74,7 +84,7 @@ NVIDIA DeepStream SDK 6.1.1 / 6.1 / 6.0.1 / 6.0 configuration for YOLO models
|
|
|
|
|
* [CUDA 11.6 Update 1](https://developer.nvidia.com/cuda-11-6-1-download-archive?target_os=Linux&target_arch=x86_64&Distribution=Ubuntu&target_version=20.04&target_type=runfile_local)
|
|
|
|
|
* [TensorRT 8.2 GA Update 4 (8.2.5.1)](https://developer.nvidia.com/nvidia-tensorrt-8x-download)
|
|
|
|
|
* [NVIDIA Driver 510.47.03](https://www.nvidia.com.br/Download/index.aspx)
|
|
|
|
|
* [NVIDIA DeepStream SDK 6.1](https://developer.nvidia.com/deepstream-getting-started)
|
|
|
|
|
* [NVIDIA DeepStream SDK 6.1](https://developer.nvidia.com/deepstream-sdk-download-tesla-archived)
|
|
|
|
|
* [GStreamer 1.16.2](https://gstreamer.freedesktop.org/)
|
|
|
|
|
* [DeepStream-Yolo](https://github.com/marcoslucianops/DeepStream-Yolo)
|
|
|
|
|
|
|
|
|
|
@@ -83,15 +93,21 @@ NVIDIA DeepStream SDK 6.1.1 / 6.1 / 6.0.1 / 6.0 configuration for YOLO models
|
|
|
|
|
* [Ubuntu 18.04](https://releases.ubuntu.com/18.04.6/)
|
|
|
|
|
* [CUDA 11.4 Update 1](https://developer.nvidia.com/cuda-11-4-1-download-archive?target_os=Linux&target_arch=x86_64&Distribution=Ubuntu&target_version=18.04&target_type=runfile_local)
|
|
|
|
|
* [TensorRT 8.0 GA (8.0.1)](https://developer.nvidia.com/nvidia-tensorrt-8x-download)
|
|
|
|
|
* [NVIDIA Driver >= 470.63.01](https://www.nvidia.com.br/Download/index.aspx)
|
|
|
|
|
* [NVIDIA Driver 470.63.01](https://www.nvidia.com.br/Download/index.aspx)
|
|
|
|
|
* [NVIDIA DeepStream SDK 6.0.1 / 6.0](https://developer.nvidia.com/deepstream-sdk-download-tesla-archived)
|
|
|
|
|
* [GStreamer 1.14.5](https://gstreamer.freedesktop.org/)
|
|
|
|
|
* [DeepStream-Yolo](https://github.com/marcoslucianops/DeepStream-Yolo)
|
|
|
|
|
|
|
|
|
|
#### DeepStream 6.2 on Jetson platform
|
|
|
|
|
|
|
|
|
|
* [JetPack 5.1.1 / 5.1](https://developer.nvidia.com/embedded/jetpack)
|
|
|
|
|
* [NVIDIA DeepStream SDK 6.2](https://developer.nvidia.com/deepstream-sdk)
|
|
|
|
|
* [DeepStream-Yolo](https://github.com/marcoslucianops/DeepStream-Yolo)
|
|
|
|
|
|
|
|
|
|
#### DeepStream 6.1.1 on Jetson platform
|
|
|
|
|
|
|
|
|
|
* [JetPack 5.0.2](https://developer.nvidia.com/embedded/jetpack)
|
|
|
|
|
* [NVIDIA DeepStream SDK 6.1.1](https://developer.nvidia.com/deepstream-sdk)
|
|
|
|
|
* [JetPack 5.0.2](https://developer.nvidia.com/embedded/jetpack-sdk-502)
|
|
|
|
|
* [NVIDIA DeepStream SDK 6.1.1](https://developer.nvidia.com/embedded/deepstream-on-jetson-downloads-archived)
|
|
|
|
|
* [DeepStream-Yolo](https://github.com/marcoslucianops/DeepStream-Yolo)
|
|
|
|
|
|
|
|
|
|
#### DeepStream 6.1 on Jetson platform
|
|
|
|
|
@@ -193,6 +209,165 @@ topk = 300
|
|
|
|
|
|
|
|
|
|
To install the DeepStream on dGPU (x86 platform), without docker, we need to do some steps to prepare the computer.
|
|
|
|
|
|
|
|
|
|
<details><summary>DeepStream 6.2</summary>
|
|
|
|
|
|
|
|
|
|
#### 1. Disable Secure Boot in BIOS
|
|
|
|
|
|
|
|
|
|
#### 2. Install dependencies
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
sudo apt-get update
|
|
|
|
|
sudo apt-get install gcc make git libtool autoconf autogen pkg-config cmake
|
|
|
|
|
sudo apt-get install python3 python3-dev python3-pip
|
|
|
|
|
sudo apt-get install dkms
|
|
|
|
|
sudo apt install libssl1.1 libgstreamer1.0-0 gstreamer1.0-tools gstreamer1.0-plugins-good gstreamer1.0-plugins-bad gstreamer1.0-plugins-ugly gstreamer1.0-libav libgstreamer-plugins-base1.0-dev libgstrtspserver-1.0-0 libjansson4 libyaml-cpp-dev libjsoncpp-dev protobuf-compiler
|
|
|
|
|
sudo apt-get install linux-headers-$(uname -r)
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
**NOTE**: Purge all NVIDIA driver, CUDA, etc (replace $CUDA_PATH to your CUDA path)
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
sudo nvidia-uninstall
|
|
|
|
|
sudo $CUDA_PATH/bin/cuda-uninstaller
|
|
|
|
|
sudo apt-get remove --purge '*nvidia*'
|
|
|
|
|
sudo apt-get remove --purge '*cuda*'
|
|
|
|
|
sudo apt-get remove --purge '*cudnn*'
|
|
|
|
|
sudo apt-get remove --purge '*tensorrt*'
|
|
|
|
|
sudo apt autoremove --purge && sudo apt autoclean && sudo apt clean
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
#### 3. Install CUDA Keyring
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64/cuda-keyring_1.0-1_all.deb
|
|
|
|
|
sudo dpkg -i cuda-keyring_1.0-1_all.deb
|
|
|
|
|
sudo apt-get update
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
#### 4. Download and install NVIDIA Driver
|
|
|
|
|
|
|
|
|
|
<details><summary>TITAN, GeForce RTX / GTX series and RTX / Quadro series</summary><blockquote>
|
|
|
|
|
|
|
|
|
|
- Download
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
wget https://us.download.nvidia.com/XFree86/Linux-x86_64/525.105.17/NVIDIA-Linux-x86_64-525.105.17.run
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
<blockquote><details><summary>Laptop</summary>
|
|
|
|
|
|
|
|
|
|
* Run
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
sudo sh NVIDIA-Linux-x86_64-525.105.17.run --no-cc-version-check --silent --disable-nouveau --dkms --install-libglvnd
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
**NOTE**: This step will disable the nouveau drivers.
|
|
|
|
|
|
|
|
|
|
* Reboot
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
sudo reboot
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
* Install
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
sudo sh NVIDIA-Linux-x86_64-525.105.17.run --no-cc-version-check --silent --disable-nouveau --dkms --install-libglvnd
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
**NOTE**: If you are using a laptop with NVIDIA Optimius, run
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
sudo apt-get install nvidia-prime
|
|
|
|
|
sudo prime-select nvidia
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
</details></blockquote>
|
|
|
|
|
|
|
|
|
|
<blockquote><details><summary>Desktop</summary>
|
|
|
|
|
|
|
|
|
|
* Run
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
sudo sh NVIDIA-Linux-x86_64-525.105.17.run --no-cc-version-check --silent --disable-nouveau --dkms --install-libglvnd --run-nvidia-xconfig
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
**NOTE**: This step will disable the nouveau drivers.
|
|
|
|
|
|
|
|
|
|
* Reboot
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
sudo reboot
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
* Install
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
sudo sh NVIDIA-Linux-x86_64-525.105.17.run --no-cc-version-check --silent --disable-nouveau --dkms --install-libglvnd --run-nvidia-xconfig
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
</details></blockquote>
|
|
|
|
|
|
|
|
|
|
</blockquote></details>
|
|
|
|
|
|
|
|
|
|
<details><summary>Data center / Tesla series</summary><blockquote>
|
|
|
|
|
|
|
|
|
|
- Download
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
wget https://us.download.nvidia.com/XFree86/Linux-x86_64/525.105.17/NVIDIA-Linux-x86_64-525.105.17.run
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
* Run
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
sudo sh NVIDIA-Linux-x86_64-510.47.03.run --no-cc-version-check --silent --disable-nouveau --dkms --install-libglvnd --run-nvidia-xconfig
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
</blockquote></details>
|
|
|
|
|
|
|
|
|
|
#### 5. Download and install CUDA
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
wget https://developer.download.nvidia.com/compute/cuda/11.8.0/local_installers/cuda_11.8.0_520.61.05_linux.run
|
|
|
|
|
sudo sh cuda_11.8.0_520.61.05_linux.run --silent --toolkit
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
* Export environment variables
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
echo $'export PATH=/usr/local/cuda-11.8/bin${PATH:+:${PATH}}\nexport LD_LIBRARY_PATH=/usr/local/cuda-11.8/lib64${LD_LIBRARY_PATH:+:${LD_LIBRARY_PATH}}' >> ~/.bashrc && source ~/.bashrc
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
#### 6. Install TensorRT
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
sudo apt-key adv --fetch-keys https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64/3bf863cc.pub
|
|
|
|
|
sudo add-apt-repository "deb https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64/ /"
|
|
|
|
|
sudo apt-get update
|
|
|
|
|
sudo apt-get install libnvinfer8=8.5.2-1+cuda11.8 libnvinfer-plugin8=8.5.2-1+cuda11.8 libnvparsers8=8.5.2-1+cuda11.8 libnvonnxparsers8=8.5.2-1+cuda11.8 libnvinfer-bin=8.5.2-1+cuda11.8 libnvinfer-dev=8.5.2-1+cuda11.8 libnvinfer-plugin-dev=8.5.2-1+cuda11.8 libnvparsers-dev=8.5.2-1+cuda11.8 libnvonnxparsers-dev=8.5.2-1+cuda11.8 libnvinfer-samples=8.5.2-1+cuda11.8 libcudnn8=8.7.0.84-1+cuda11.8 libcudnn8-dev=8.7.0.84-1+cuda11.8 python3-libnvinfer=8.5.2-1+cuda11.8 python3-libnvinfer-dev=8.5.2-1+cuda11.8
|
|
|
|
|
sudo apt-mark hold libnvinfer* libnvparsers* libnvonnxparsers* libcudnn8* python3-libnvinfer* tensorrt
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
#### 7. Download from [NVIDIA website](https://developer.nvidia.com/deepstream-getting-started) and install the DeepStream SDK
|
|
|
|
|
|
|
|
|
|
DeepStream 6.2 for Servers and Workstations (.deb)
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
sudo apt-get install ./deepstream-6.2_6.2.0-1_amd64.deb
|
|
|
|
|
rm ${HOME}/.cache/gstreamer-1.0/registry.x86_64.bin
|
|
|
|
|
sudo ln -snf /usr/local/cuda-11.8 /usr/local/cuda
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
#### 8. Reboot the computer
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
sudo reboot
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
</details>
|
|
|
|
|
|
|
|
|
|
<details><summary>DeepStream 6.1.1</summary>
|
|
|
|
|
|
|
|
|
|
#### 1. Disable Secure Boot in BIOS
|
|
|
|
|
@@ -230,17 +405,15 @@ sudo apt-get update
|
|
|
|
|
|
|
|
|
|
#### 4. Download and install NVIDIA Driver
|
|
|
|
|
|
|
|
|
|
* TITAN, GeForce RTX / GTX series and RTX / Quadro series
|
|
|
|
|
<details><summary>TITAN, GeForce RTX / GTX series and RTX / Quadro series</summary><blockquote>
|
|
|
|
|
|
|
|
|
|
- Download
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
wget https://us.download.nvidia.com/XFree86/Linux-x86_64/515.65.01/NVIDIA-Linux-x86_64-515.65.01.run
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
* Data center / Tesla series
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
wget https://us.download.nvidia.com/tesla/515.65.01/NVIDIA-Linux-x86_64-515.65.01.run
|
|
|
|
|
```
|
|
|
|
|
<blockquote><details><summary>Laptop</summary>
|
|
|
|
|
|
|
|
|
|
* Run
|
|
|
|
|
|
|
|
|
|
@@ -269,6 +442,50 @@ sudo apt-get install nvidia-prime
|
|
|
|
|
sudo prime-select nvidia
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
</details></blockquote>
|
|
|
|
|
|
|
|
|
|
<blockquote><details><summary>Desktop</summary>
|
|
|
|
|
|
|
|
|
|
* Run
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
sudo sh NVIDIA-Linux-x86_64-515.65.01.run --silent --disable-nouveau --dkms --install-libglvnd --run-nvidia-xconfig
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
**NOTE**: This step will disable the nouveau drivers.
|
|
|
|
|
|
|
|
|
|
* Reboot
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
sudo reboot
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
* Install
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
sudo sh NVIDIA-Linux-x86_64-515.65.01.run --silent --disable-nouveau --dkms --install-libglvnd --run-nvidia-xconfig
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
</details></blockquote>
|
|
|
|
|
|
|
|
|
|
</blockquote></details>
|
|
|
|
|
|
|
|
|
|
<details><summary>Data center / Tesla series</summary><blockquote>
|
|
|
|
|
|
|
|
|
|
- Download
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
wget https://us.download.nvidia.com/tesla/515.65.01/NVIDIA-Linux-x86_64-515.65.01.run
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
* Run
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
sudo sh NVIDIA-Linux-x86_64-515.65.01.run --silent --disable-nouveau --dkms --install-libglvnd --run-nvidia-xconfig
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
</blockquote></details>
|
|
|
|
|
|
|
|
|
|
#### 5. Download and install CUDA
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
@@ -349,17 +566,15 @@ sudo apt-get update
|
|
|
|
|
|
|
|
|
|
#### 4. Download and install NVIDIA Driver
|
|
|
|
|
|
|
|
|
|
* TITAN, GeForce RTX / GTX series and RTX / Quadro series
|
|
|
|
|
<details><summary>TITAN, GeForce RTX / GTX series and RTX / Quadro series</summary><blockquote>
|
|
|
|
|
|
|
|
|
|
- Download
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
wget https://us.download.nvidia.com/XFree86/Linux-x86_64/510.47.03/NVIDIA-Linux-x86_64-510.47.03.run
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
* Data center / Tesla series
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
wget https://us.download.nvidia.com/tesla/510.47.03/NVIDIA-Linux-x86_64-510.47.03.run
|
|
|
|
|
```
|
|
|
|
|
<blockquote><details><summary>Laptop</summary>
|
|
|
|
|
|
|
|
|
|
* Run
|
|
|
|
|
|
|
|
|
|
@@ -388,6 +603,50 @@ sudo apt-get install nvidia-prime
|
|
|
|
|
sudo prime-select nvidia
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
</details></blockquote>
|
|
|
|
|
|
|
|
|
|
<blockquote><details><summary>Desktop</summary>
|
|
|
|
|
|
|
|
|
|
* Run
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
sudo sh NVIDIA-Linux-x86_64-510.47.03.run --silent --disable-nouveau --dkms --install-libglvnd --run-nvidia-xconfig
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
**NOTE**: This step will disable the nouveau drivers.
|
|
|
|
|
|
|
|
|
|
* Reboot
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
sudo reboot
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
* Install
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
sudo sh NVIDIA-Linux-x86_64-510.47.03.run --silent --disable-nouveau --dkms --install-libglvnd --run-nvidia-xconfig
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
</details></blockquote>
|
|
|
|
|
|
|
|
|
|
</blockquote></details>
|
|
|
|
|
|
|
|
|
|
<details><summary>Data center / Tesla series</summary><blockquote>
|
|
|
|
|
|
|
|
|
|
- Download
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
wget https://us.download.nvidia.com/tesla/510.47.03/NVIDIA-Linux-x86_64-510.47.03.run
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
* Run
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
sudo sh NVIDIA-Linux-x86_64-510.47.03.run --silent --disable-nouveau --dkms --install-libglvnd --run-nvidia-xconfig
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
</blockquote></details>
|
|
|
|
|
|
|
|
|
|
#### 5. Download and install CUDA
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
@@ -486,17 +745,15 @@ sudo apt-get update
|
|
|
|
|
|
|
|
|
|
#### 4. Download and install NVIDIA Driver
|
|
|
|
|
|
|
|
|
|
* TITAN, GeForce RTX / GTX series and RTX / Quadro series
|
|
|
|
|
<details><summary>TITAN, GeForce RTX / GTX series and RTX / Quadro series</summary><blockquote>
|
|
|
|
|
|
|
|
|
|
- Download
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
wget https://us.download.nvidia.com/XFree86/Linux-x86_64/470.129.06/NVIDIA-Linux-x86_64-470.129.06.run
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
* Data center / Tesla series
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
wget https://us.download.nvidia.com/tesla/470.129.06/NVIDIA-Linux-x86_64-470.129.06.run
|
|
|
|
|
```
|
|
|
|
|
<blockquote><details><summary>Laptop</summary>
|
|
|
|
|
|
|
|
|
|
* Run
|
|
|
|
|
|
|
|
|
|
@@ -529,6 +786,56 @@ sudo apt-get install nvidia-prime
|
|
|
|
|
sudo prime-select nvidia
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
</details></blockquote>
|
|
|
|
|
|
|
|
|
|
<blockquote><details><summary>Desktop</summary>
|
|
|
|
|
|
|
|
|
|
* Run
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
sudo sh NVIDIA-Linux-x86_64-470.129.06.run --silent --disable-nouveau --dkms --install-libglvnd --run-nvidia-xconfig
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
**NOTE**: This step will disable the nouveau drivers.
|
|
|
|
|
|
|
|
|
|
**NOTE**: Remove --dkms flag if you installed the 5.11.0 kernel.
|
|
|
|
|
|
|
|
|
|
* Reboot
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
sudo reboot
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
* Install
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
sudo sh NVIDIA-Linux-x86_64-470.129.06.run --silent --disable-nouveau --dkms --install-libglvnd --run-nvidia-xconfig
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
**NOTE**: Remove --dkms flag if you installed the 5.11.0 kernel.
|
|
|
|
|
|
|
|
|
|
</details></blockquote>
|
|
|
|
|
|
|
|
|
|
</blockquote></details>
|
|
|
|
|
|
|
|
|
|
<details><summary>Data center / Tesla series</summary><blockquote>
|
|
|
|
|
|
|
|
|
|
- Download
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
wget https://us.download.nvidia.com/tesla/470.129.06/NVIDIA-Linux-x86_64-470.129.06.run
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
* Run
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
sudo sh NVIDIA-Linux-x86_64-470.129.06.run --silent --disable-nouveau --dkms --install-libglvnd --run-nvidia-xconfig
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
**NOTE**: Remove --dkms flag if you installed the 5.11.0 kernel.
|
|
|
|
|
|
|
|
|
|
</blockquote></details>
|
|
|
|
|
|
|
|
|
|
#### 5. Download and install CUDA
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
@@ -598,6 +905,12 @@ cd DeepStream-Yolo
|
|
|
|
|
|
|
|
|
|
#### 3. Compile the lib
|
|
|
|
|
|
|
|
|
|
* DeepStream 6.2 on x86 platform
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
CUDA_VER=11.8 make -C nvdsinfer_custom_impl_Yolo
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
* DeepStream 6.1.1 on x86 platform
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
@@ -616,7 +929,7 @@ cd DeepStream-Yolo
|
|
|
|
|
CUDA_VER=11.4 make -C nvdsinfer_custom_impl_Yolo
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
* DeepStream 6.1.1 / 6.1 on Jetson platform
|
|
|
|
|
* DeepStream 6.2 / 6.1.1 / 6.1 on Jetson platform
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
CUDA_VER=11.4 make -C nvdsinfer_custom_impl_Yolo
|
|
|
|
|
@@ -661,15 +974,15 @@ config-file=config_infer_primary_yoloV2.txt
|
|
|
|
|
* x86 platform
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
nvcr.io/nvidia/deepstream:6.1.1-devel
|
|
|
|
|
nvcr.io/nvidia/deepstream:6.1.1-triton
|
|
|
|
|
nvcr.io/nvidia/deepstream:6.2-devel
|
|
|
|
|
nvcr.io/nvidia/deepstream:6.2-triton
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
* Jetson platform
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
nvcr.io/nvidia/deepstream-l4t:6.1.1-samples
|
|
|
|
|
nvcr.io/nvidia/deepstream-l4t:6.1.1-triton
|
|
|
|
|
nvcr.io/nvidia/deepstream-l4t:6.2-samples
|
|
|
|
|
nvcr.io/nvidia/deepstream-l4t:6.2-triton
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
**NOTE**: To compile the `nvdsinfer_custom_impl_Yolo`, you need to install the g++ inside the container
|
|
|
|
|
@@ -678,26 +991,12 @@ config-file=config_infer_primary_yoloV2.txt
|
|
|
|
|
apt-get install build-essential
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
**NOTE**: With DeepStream 6.1.1, the docker containers do not package libraries necessary for certain multimedia operations like audio data parsing, CPU decode, and CPU encode. This change could affect processing certain video streams/files like mp4 that include audio track. Please run the below script inside the docker images to install additional packages that might be necessary to use all of the DeepStreamSDK features:
|
|
|
|
|
**NOTE**: With DeepStream 6.2, the docker containers do not package libraries necessary for certain multimedia operations like audio data parsing, CPU decode, and CPU encode. This change could affect processing certain video streams/files like mp4 that include audio track. Please run the below script inside the docker images to install additional packages that might be necessary to use all of the DeepStreamSDK features:
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
/opt/nvidia/deepstream/deepstream/user_additional_install.sh
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
**NOTE**: With DeepStream 6.1, the container image missed to include certain header files that will be available on host machine with Compute libraries installed from Jetpack. To mount the headers, use:
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
-v /usr/include/aarch64-linux-gnu/NvInfer.h:/usr/include/aarch64-linux-gnu/NvInfer.h -v /usr/include/aarch64-linux-gnu/NvInferLegacyDims.h:/usr/include/aarch64-linux-gnu/NvInferLegacyDims.h -v /usr/include/aarch64-linux-gnu/NvInferRuntimeCommon.h:/usr/include/aarch64-linux-gnu/NvInferRuntimeCommon.h -v /usr/include/aarch64-linux-gnu/NvInferVersion.h:/usr/include/aarch64-linux-gnu/NvInferVersion.h -v /usr/include/aarch64-linux-gnu/NvInferRuntime.h:/usr/include/aarch64-linux-gnu/NvInferRuntime.h -v /usr/include/aarch64-linux-gnu/NvInferImpl.h:/usr/include/aarch64-linux-gnu/NvInferImpl.h -v /usr/include/aarch64-linux-gnu/NvCaffeParser.h:/usr/include/aarch64-linux-gnu/NvCaffeParser.h -v /usr/include/aarch64-linux-gnu/NvUffParser.h:/usr/include/aarch64-linux-gnu/NvUffParser.h -v /usr/include/aarch64-linux-gnu/NvInferPlugin.h:/usr/include/aarch64-linux-gnu/NvInferPlugin.h -v /usr/include/aarch64-linux-gnu/NvInferPluginUtils.h:/usr/include/aarch64-linux-gnu/NvInferPluginUtils.h -v /usr/local/cuda/:/usr/local/cuda/
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
<details>
|
|
|
|
|
<summary>Example</summary>
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
sudo docker run -it --rm --net=host --runtime nvidia -e DISPLAY=$DISPLAY -w /opt/nvidia/deepstream/deepstream-6.1 -v /tmp/.X11-unix/:/tmp/.X11-unix -v /usr/include/aarch64-linux-gnu/NvInfer.h:/usr/include/aarch64-linux-gnu/NvInfer.h -v /usr/include/aarch64-linux-gnu/NvInferLegacyDims.h:/usr/include/aarch64-linux-gnu/NvInferLegacyDims.h -v /usr/include/aarch64-linux-gnu/NvInferRuntimeCommon.h:/usr/include/aarch64-linux-gnu/NvInferRuntimeCommon.h -v /usr/include/aarch64-linux-gnu/NvInferVersion.h:/usr/include/aarch64-linux-gnu/NvInferVersion.h -v /usr/include/aarch64-linux-gnu/NvInferRuntime.h:/usr/include/aarch64-linux-gnu/NvInferRuntime.h -v /usr/include/aarch64-linux-gnu/NvInferImpl.h:/usr/include/aarch64-linux-gnu/NvInferImpl.h -v /usr/include/aarch64-linux-gnu/NvCaffeParser.h:/usr/include/aarch64-linux-gnu/NvCaffeParser.h -v /usr/include/aarch64-linux-gnu/NvUffParser.h:/usr/include/aarch64-linux-gnu/NvUffParser.h -v /usr/include/aarch64-linux-gnu/NvInferPlugin.h:/usr/include/aarch64-linux-gnu/NvInferPlugin.h -v /usr/include/aarch64-linux-gnu/NvInferPluginUtils.h:/usr/include/aarch64-linux-gnu/NvInferPluginUtils.h -v /usr/local/cuda/:/usr/local/cuda/ nvcr.io/nvidia/deepstream-l4t:6.1-samples
|
|
|
|
|
```
|
|
|
|
|
</details>
|
|
|
|
|
|
|
|
|
|
##
|
|
|
|
|
|
|
|
|
|
### NMS Configuration
|
|
|
|
|
@@ -729,6 +1028,12 @@ sudo apt-get install libopencv-dev
|
|
|
|
|
|
|
|
|
|
#### 2. Compile/recompile the `nvdsinfer_custom_impl_Yolo` lib with OpenCV support
|
|
|
|
|
|
|
|
|
|
* DeepStream 6.2 on x86 platform
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
CUDA_VER=11.8 OPENCV=1 make -C nvdsinfer_custom_impl_Yolo
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
* DeepStream 6.1.1 on x86 platform
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
@@ -747,7 +1052,7 @@ sudo apt-get install libopencv-dev
|
|
|
|
|
CUDA_VER=11.4 OPENCV=1 make -C nvdsinfer_custom_impl_Yolo
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
* DeepStream 6.1.1 / 6.1 on Jetson platform
|
|
|
|
|
* DeepStream 6.2 / 6.1.1 / 6.1 on Jetson platform
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
CUDA_VER=11.4 OPENCV=1 make -C nvdsinfer_custom_impl_Yolo
|
|
|
|
|
|