thebears/deepstream_yolo
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Update to DeepStream 6.3

Browse Source
This commit is contained in:
Marcos Luciano
2023-08-25 17:19:39 -03:00
parent f630b10a80
commit d24ae06740
14 changed files with 286 additions and 26 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
docs/DAMOYOLO.md
View File

@@ -98,6 +98,12 @@ Copy the generated ONNX model file and labels.txt file (if generated) to the `De
Open the `DeepStream-Yolo` folder and compile the lib
* DeepStream 6.3 on x86 platform
```
CUDA_VER=12.1 make -C nvdsinfer_custom_impl_Yolo
```
* DeepStream 6.2 on x86 platform
```
@@ -128,7 +134,7 @@ Open the `DeepStream-Yolo` folder and compile the lib
CUDA_VER=11.1 make -C nvdsinfer_custom_impl_Yolo
```
* DeepStream 6.2 / 6.1.1 / 6.1 on Jetson platform
* DeepStream 6.3 / 6.2 / 6.1.1 / 6.1 on Jetson platform
```
CUDA_VER=11.4 make -C nvdsinfer_custom_impl_Yolo

8
docs/INT8Calibration.md
View File

@@ -8,6 +8,12 @@ sudo apt-get install libopencv-dev
### 2. Compile/recompile the `nvdsinfer_custom_impl_Yolo` lib with OpenCV support
* DeepStream 6.3 on x86 platform
```
CUDA_VER=12.1 OPENCV=1 make -C nvdsinfer_custom_impl_Yolo
```
* DeepStream 6.2 on x86 platform
```
@@ -38,7 +44,7 @@ sudo apt-get install libopencv-dev
CUDA_VER=11.1 OPENCV=1 make -C nvdsinfer_custom_impl_Yolo
```
* DeepStream 6.2 / 6.1.1 / 6.1 on Jetson platform
* DeepStream 6.3 / 6.2 / 6.1.1 / 6.1 on Jetson platform
```
CUDA_VER=11.4 OPENCV=1 make -C nvdsinfer_custom_impl_Yolo

8
docs/PPYOLOE.md
View File

@@ -75,6 +75,12 @@ Copy the generated ONNX model file and labels.txt file (if generated) to the `De
Open the `DeepStream-Yolo` folder and compile the lib
* DeepStream 6.3 on x86 platform
```
CUDA_VER=12.1 make -C nvdsinfer_custom_impl_Yolo
```
* DeepStream 6.2 on x86 platform
```
@@ -105,7 +111,7 @@ Open the `DeepStream-Yolo` folder and compile the lib
CUDA_VER=11.1 make -C nvdsinfer_custom_impl_Yolo
```
* DeepStream 6.2 / 6.1.1 / 6.1 on Jetson platform
* DeepStream 6.3 / 6.2 / 6.1.1 / 6.1 on Jetson platform
```
CUDA_VER=11.4 make -C nvdsinfer_custom_impl_Yolo

8
docs/YOLONAS.md
View File

@@ -131,6 +131,12 @@ Copy the generated ONNX model file to the `DeepStream-Yolo` folder.
Open the `DeepStream-Yolo` folder and compile the lib
* DeepStream 6.3 on x86 platform
```
CUDA_VER=12.1 make -C nvdsinfer_custom_impl_Yolo
```
* DeepStream 6.2 on x86 platform
```
@@ -161,7 +167,7 @@ Open the `DeepStream-Yolo` folder and compile the lib
CUDA_VER=11.1 make -C nvdsinfer_custom_impl_Yolo
```
* DeepStream 6.2 / 6.1.1 / 6.1 on Jetson platform
* DeepStream 6.3 / 6.2 / 6.1.1 / 6.1 on Jetson platform
```
CUDA_VER=11.4 make -C nvdsinfer_custom_impl_Yolo

8
docs/YOLOR.md
View File

@@ -116,6 +116,12 @@ Copy the generated ONNX model file and labels.txt file (if generated) to the `De
Open the `DeepStream-Yolo` folder and compile the lib
* DeepStream 6.3 on x86 platform
```
CUDA_VER=12.1 make -C nvdsinfer_custom_impl_Yolo
```
* DeepStream 6.2 on x86 platform
```
@@ -146,7 +152,7 @@ Open the `DeepStream-Yolo` folder and compile the lib
CUDA_VER=11.1 make -C nvdsinfer_custom_impl_Yolo
```
* DeepStream 6.2 / 6.1.1 / 6.1 on Jetson platform
* DeepStream 6.3 / 6.2 / 6.1.1 / 6.1 on Jetson platform
```
CUDA_VER=11.4 make -C nvdsinfer_custom_impl_Yolo

8
docs/YOLOX.md
View File

@@ -80,6 +80,12 @@ Copy the generated ONNX model file to the `DeepStream-Yolo` folder.
Open the `DeepStream-Yolo` folder and compile the lib
* DeepStream 6.3 on x86 platform
```
CUDA_VER=12.1 make -C nvdsinfer_custom_impl_Yolo
```
* DeepStream 6.2 on x86 platform
```
@@ -110,7 +116,7 @@ Open the `DeepStream-Yolo` folder and compile the lib
CUDA_VER=11.1 make -C nvdsinfer_custom_impl_Yolo
```
* DeepStream 6.2 / 6.1.1 / 6.1 on Jetson platform
* DeepStream 6.3 / 6.2 / 6.1.1 / 6.1 on Jetson platform
```
CUDA_VER=11.4 make -C nvdsinfer_custom_impl_Yolo

8
docs/YOLOv5.md
View File

@@ -108,6 +108,12 @@ Copy the generated ONNX model file and labels.txt file (if generated) to the `De
Open the `DeepStream-Yolo` folder and compile the lib
* DeepStream 6.3 on x86 platform
```
CUDA_VER=12.1 make -C nvdsinfer_custom_impl_Yolo
```
* DeepStream 6.2 on x86 platform
```
@@ -138,7 +144,7 @@ Open the `DeepStream-Yolo` folder and compile the lib
CUDA_VER=11.1 make -C nvdsinfer_custom_impl_Yolo
```
* DeepStream 6.2 / 6.1.1 / 6.1 on Jetson platform
* DeepStream 6.3 / 6.2 / 6.1.1 / 6.1 on Jetson platform
```
CUDA_VER=11.4 make -C nvdsinfer_custom_impl_Yolo

8
docs/YOLOv6.md
View File

@@ -108,6 +108,12 @@ Copy the generated ONNX model file to the `DeepStream-Yolo` folder.
Open the `DeepStream-Yolo` folder and compile the lib
* DeepStream 6.3 on x86 platform
```
CUDA_VER=12.1 make -C nvdsinfer_custom_impl_Yolo
```
* DeepStream 6.2 on x86 platform
```
@@ -138,7 +144,7 @@ Open the `DeepStream-Yolo` folder and compile the lib
CUDA_VER=11.1 make -C nvdsinfer_custom_impl_Yolo
```
* DeepStream 6.2 / 6.1.1 / 6.1 on Jetson platform
* DeepStream 6.3 / 6.2 / 6.1.1 / 6.1 on Jetson platform
```
CUDA_VER=11.4 make -C nvdsinfer_custom_impl_Yolo

8
docs/YOLOv7.md
View File

@@ -110,6 +110,12 @@ Copy the generated ONNX model file and labels.txt file (if generated) to the `De
Open the `DeepStream-Yolo` folder and compile the lib
* DeepStream 6.3 on x86 platform
```
CUDA_VER=12.1 make -C nvdsinfer_custom_impl_Yolo
```
* DeepStream 6.2 on x86 platform
```
@@ -140,7 +146,7 @@ Open the `DeepStream-Yolo` folder and compile the lib
CUDA_VER=11.1 make -C nvdsinfer_custom_impl_Yolo
```
* DeepStream 6.2 / 6.1.1 / 6.1 on Jetson platform
* DeepStream 6.3 / 6.2 / 6.1.1 / 6.1 on Jetson platform
```
CUDA_VER=11.4 make -C nvdsinfer_custom_impl_Yolo

8
docs/YOLOv8.md
View File

@@ -101,6 +101,12 @@ Copy the generated ONNX model file and labels.txt file (if generated) to the `De
Open the `DeepStream-Yolo` folder and compile the lib
* DeepStream 6.3 on x86 platform
```
CUDA_VER=12.1 make -C nvdsinfer_custom_impl_Yolo
```
* DeepStream 6.2 on x86 platform
```
@@ -131,7 +137,7 @@ Open the `DeepStream-Yolo` folder and compile the lib
CUDA_VER=11.1 make -C nvdsinfer_custom_impl_Yolo
```
* DeepStream 6.2 / 6.1.1 / 6.1 on Jetson platform
* DeepStream 6.3 / 6.2 / 6.1.1 / 6.1 on Jetson platform
```
CUDA_VER=11.4 make -C nvdsinfer_custom_impl_Yolo

16
docs/customModels.md
View File

@@ -25,6 +25,12 @@ cd DeepStream-Yolo
### Compile the lib
* DeepStream 6.3 on x86 platform
```
CUDA_VER=12.1 make -C nvdsinfer_custom_impl_Yolo
```
* DeepStream 6.2 on x86 platform
```
@@ -49,13 +55,19 @@ cd DeepStream-Yolo
CUDA_VER=11.4 make -C nvdsinfer_custom_impl_Yolo
```
* DeepStream 6.2 / 6.1.1 / 6.1 on Jetson platform
* DeepStream 5.1 on x86 platform
```
CUDA_VER=11.1 make -C nvdsinfer_custom_impl_Yolo
```
* DeepStream 6.3 / 6.2 / 6.1.1 / 6.1 on Jetson platform
```
CUDA_VER=11.4 make -C nvdsinfer_custom_impl_Yolo
```
* DeepStream 6.0.1 / 6.0 on Jetson platform
* DeepStream 6.0.1 / 6.0 / 5.1 on Jetson platform
```
CUDA_VER=10.2 make -C nvdsinfer_custom_impl_Yolo

164
docs/dGPUInstalation.md
View File

@@ -2,6 +2,166 @@
To install the DeepStream on dGPU (x86 platform), without docker, we need to do some steps to prepare the computer.
<details><summary>DeepStream 6.3</summary>
### 1. Disable Secure Boot in BIOS
### 2. Install dependencies
```
sudo apt-get update
sudo apt-get install gcc make git libtool autoconf autogen pkg-config cmake
sudo apt-get install python3 python3-dev python3-pip
sudo apt-get install dkms
sudo apt install libssl1.1 libgstreamer1.0-0 gstreamer1.0-tools gstreamer1.0-plugins-good gstreamer1.0-plugins-bad gstreamer1.0-plugins-ugly gstreamer1.0-libav libgstreamer-plugins-base1.0-dev libgstrtspserver-1.0-0 libjansson4 libyaml-cpp-dev libjsoncpp-dev protobuf-compiler
sudo apt-get install linux-headers-$(uname -r)
```
**NOTE**: Purge all NVIDIA driver, CUDA, etc (replace $CUDA_PATH to your CUDA path)
```
sudo nvidia-uninstall
sudo $CUDA_PATH/bin/cuda-uninstaller
sudo apt-get remove --purge '*nvidia*'
sudo apt-get remove --purge '*cuda*'
sudo apt-get remove --purge '*cudnn*'
sudo apt-get remove --purge '*tensorrt*'
sudo apt autoremove --purge && sudo apt autoclean && sudo apt clean
```
### 3. Install CUDA Keyring
```
wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64/cuda-keyring_1.0-1_all.deb
sudo dpkg -i cuda-keyring_1.0-1_all.deb
sudo apt-get update
```
### 4. Download and install NVIDIA Driver
<details><summary>TITAN, GeForce RTX / GTX series and RTX / Quadro series</summary><blockquote>
- Download
```
wget https://us.download.nvidia.com/XFree86/Linux-x86_64/530.41.03/NVIDIA-Linux-x86_64-530.41.03.run
```
<blockquote><details><summary>Laptop</summary>
* Run
```
sudo sh NVIDIA-Linux-x86_64-530.41.03.run --no-cc-version-check --silent --disable-nouveau --dkms --install-libglvnd
```
**NOTE**: This step will disable the nouveau drivers.
* Reboot
```
sudo reboot
```
* Install
```
sudo sh NVIDIA-Linux-x86_64-530.41.03.run --no-cc-version-check --silent --disable-nouveau --dkms --install-libglvnd
```
**NOTE**: If you are using a laptop with NVIDIA Optimius, run
```
sudo apt-get install nvidia-prime
sudo prime-select nvidia
```
</details></blockquote>
<blockquote><details><summary>Desktop</summary>
* Run
```
sudo sh NVIDIA-Linux-x86_64-530.41.03.run --no-cc-version-check --silent --disable-nouveau --dkms --install-libglvnd --run-nvidia-xconfig
```
**NOTE**: This step will disable the nouveau drivers.
* Reboot
```
sudo reboot
```
* Install
```
sudo sh NVIDIA-Linux-x86_64-530.41.03.run --no-cc-version-check --silent --disable-nouveau --dkms --install-libglvnd --run-nvidia-xconfig
```
</details></blockquote>
</blockquote></details>
<details><summary>Data center / Tesla series</summary><blockquote>
- Download
```
wget https://us.download.nvidia.com/tesla/525.125.06/NVIDIA-Linux-x86_64-525.125.06.run
```
* Run
```
sudo sh NVIDIA-Linux-x86_64-525.125.06.run --no-cc-version-check --silent --disable-nouveau --dkms --install-libglvnd --run-nvidia-xconfig
```
</blockquote></details>
### 5. Download and install CUDA
```
wget https://developer.download.nvidia.com/compute/cuda/12.1.1/local_installers/cuda_12.1.1_530.30.02_linux.run
sudo sh cuda_12.1.1_530.30.02_linux.run --silent --toolkit
```
* Export environment variables
```
echo $'export PATH=/usr/local/cuda-12.1/bin${PATH:+:${PATH}}\nexport LD_LIBRARY_PATH=/usr/local/cuda-12.1/lib64${LD_LIBRARY_PATH:+:${LD_LIBRARY_PATH}}' >> ~/.bashrc && source ~/.bashrc
```
### 6. Install TensorRT
```
sudo apt-key adv --fetch-keys https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64/3bf863cc.pub
sudo add-apt-repository "deb https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64/ /"
sudo apt-get update
sudo apt-get install libnvinfer8=8.5.3-1+cuda11.8 libnvinfer-plugin8=8.5.3-1+cuda11.8 libnvparsers8=8.5.3-1+cuda11.8 libnvonnxparsers8=8.5.3-1+cuda11.8 libnvinfer-bin=8.5.3-1+cuda11.8 libnvinfer-dev=8.5.3-1+cuda11.8 libnvinfer-plugin-dev=8.5.3-1+cuda11.8 libnvparsers-dev=8.5.3-1+cuda11.8 libnvonnxparsers-dev=8.5.3-1+cuda11.8 libnvinfer-samples=8.5.3-1+cuda11.8 libcudnn8=8.7.0.84-1+cuda11.8 libcudnn8-dev=8.7.0.84-1+cuda11.8 python3-libnvinfer=8.5.3-1+cuda11.8 python3-libnvinfer-dev=8.5.3-1+cuda11.8
sudo apt-mark hold libnvinfer* libnvparsers* libnvonnxparsers* libcudnn8* python3-libnvinfer* tensorrt
```
### 7. Download and install the DeepStream SDK
DeepStream 6.3 for Servers and Workstations
```
wget --content-disposition 'https://api.ngc.nvidia.com/v2/resources/org/nvidia/deepstream/6.3/files?redirect=true&path=deepstream-6.3_6.3.0-1_amd64.deb' -O deepstream-6.3_6.3.0-1_amd64.deb
sudo apt-get install ./deepstream-6.3_6.3.0-1_amd64.deb
rm ${HOME}/.cache/gstreamer-1.0/registry.x86_64.bin
sudo ln -snf /usr/local/cuda-12.1 /usr/local/cuda
```
### 8. Reboot the computer
```
sudo reboot
```
</details>
<details><summary>DeepStream 6.2</summary>
### 1. Disable Secure Boot in BIOS
@@ -109,13 +269,13 @@ sudo prime-select nvidia
- Download
```
wget https://us.download.nvidia.com/XFree86/Linux-x86_64/525.105.17/NVIDIA-Linux-x86_64-525.105.17.run
wget https://us.download.nvidia.com/tesla/525.85.12/NVIDIA-Linux-x86_64-525.85.12.run
```
* Run
```
sudo sh NVIDIA-Linux-x86_64-525.105.17.run --no-cc-version-check --silent --disable-nouveau --dkms --install-libglvnd --run-nvidia-xconfig
sudo sh NVIDIA-Linux-x86_64-525.85.12.run --no-cc-version-check --silent --disable-nouveau --dkms --install-libglvnd --run-nvidia-xconfig
```
</blockquote></details>

8
docs/multipleGIEs.md
View File

@@ -50,6 +50,12 @@ const char* YOLOLAYER_PLUGIN_VERSION {"2"};
**NOTE**: Do it for each GIE folder, replacing the GIE folder name (`gie1/nvdsinfer_custom_impl_Yolo`).
* DeepStream 6.3 on x86 platform
```
CUDA_VER=12.1 make -C gie1/nvdsinfer_custom_impl_Yolo
```
* DeepStream 6.2 on x86 platform
```
@@ -74,7 +80,7 @@ const char* YOLOLAYER_PLUGIN_VERSION {"2"};
CUDA_VER=11.4 make -C gie1/nvdsinfer_custom_impl_Yolo
```
* DeepStream 6.2 / 6.1.1 / 6.1 on Jetson platform
* DeepStream 6.3 / 6.2 / 6.1.1 / 6.1 on Jetson platform
```
CUDA_VER=11.4 make -C gie1/nvdsinfer_custom_impl_Yolo