ubuntu TensorRT
star@xmatrix:~$ star@xmatrix:~$ star@xmatrix:~$ lspci |grep -i vga 08:00.0 VGA compatible controller: ASPEED Technology, Inc. ASPEED Graphics Family (rev 30) star@xmatrix:~$ star@xmatrix:~$ star@xmatrix:~$ star@xmatrix:~$ lspci | grep -i nvidia 02:00.0 3D controller: NVIDIA Corporation GP104GL [Tesla P4] (rev a1) star@xmatrix:~$ star@xmatrix:~$ star@xmatrix:~$ cat /proc/driver/nvidia/version NVRM version: NVIDIA UNIX x86_64 Kernel Module 418.67 Sat Apr 6 03:07:24 CDT 2019 GCC version: gcc version 5.4.0 20160609 (Ubuntu 5.4.0-6ubuntu1~16.04.12) star@xmatrix:~$ star@xmatrix:~$ star@xmatrix:~$ nvidia-smi Thu Dec 26 17:19:43 2019 +-----------------------------------------------------------------------------+ | NVIDIA-SMI 418.67 Driver Version: 418.67 CUDA Version: 10.1 | |-------------------------------+----------------------+----------------------+ | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | |===============================+======================+======================| | 0 Tesla P4 Off | 00000000:02:00.0 Off | 0 | | N/A 76C P0 43W / 75W | 7483MiB / 7611MiB | 48% Default | +-------------------------------+----------------------+----------------------+ +-----------------------------------------------------------------------------+ | Processes: GPU Memory | | GPU PID Type Process name Usage | |=============================================================================| | 0 10454 C python 7473MiB | +-----------------------------------------------------------------------------+ star@xmatrix:~$ star@xmatrix:~$ star@xmatrix:~$
一、下載對應的版本html
=====================================================================================node
NVIDIA TensorRT 7.x Download
NVIDIA TensorRT is a platform for high performance deep learning inference.python
TensorRT works across all NVIDIA GPUs using the CUDA platform. The following files are for use for Linux servers and workstations running NVIDIA Quadro, GeForce, and Tesla GPUs. NVIDIA recommends Tesla V100, T4, P4, and P40 GPUs for production deployment.linux
I Agree To the Terms of the NVIDIA TensorRT License AgreementPlease download the version compatible with your development environmentshell
Documentation
TensorRT 7.0 for Linux
Debian and RPM Install Packages for Linux x86
- TensorRT 7.0.0.11 for Ubuntu 1804 and CUDA 10.2 DEB local repo packages
- TensorRT 7.0.0.11 for Ubuntu 1804 and CUDA 10.0 DEB local repo packages
- TensorRT 7.0.0.11 for Ubuntu 1604 and CUDA 10.2 DEB local repo packages
- TensorRT 7.0.0.11 for Ubuntu 1604 and CUDA 10.0 DEB local repo packages
- TensorRT 7.0.0.11 for Ubuntu 1604 and CUDA 9.0 DEB local repo packages
- TensorRT 7.0.0.11 for CentOS/RedHat 7 and CUDA 10.2 RPM local repo packages
- TensorRT 7.0.0.11 for CentOS/RedHat 7 and CUDA 10.0 RPM local repo packages
- TensorRT 7.0.0.11 for CentOS/RedHat 7 and CUDA 9.0 RPM local repo packages
Tar File Install Packages For Linux x86
- TensorRT 7.0.0.11 for Ubuntu 18.04 and CUDA 10.2 tar package
- TensorRT 7.0.0.11 for Ubuntu 18.04 and CUDA 10.0 tar package
- TensorRT 7.0.0.11 for Ubuntu 16.04 and CUDA 10.2 tar package
- TensorRT 7.0.0.11 for Ubuntu 16.04 and CUDA 10.0 tar package
- TensorRT 7.0.0.11 for Ubuntu 16.04 and CUDA 9.0 tar package
- TensorRT 7.0.0.11 for CentOS/RedHat 7 and CUDA 10.2 tar package
- TensorRT 7.0.0.11 for CentOS/RedHat 7 and CUDA 10.0 tar package
- TensorRT 7.0.0.11 for CentOS/RedHat 7 and CUDA 9.0 tar package
Debian and RPM Install Packages For Linux Power
- TensorRT 7.0.0.11 for Ubuntu 1804 and CUDA 10.2 DEB local repo packages
- TensorRT 7.0.0.11 for CentOS/RedHat 7 and CUDA 10.2 RPM local repo packages
Tar File Install Packages For Linux Power
- TensorRT-7.0.0.11 for Ubuntu 18.04 and CUDA 10.2 tar package
- TensorRT-7.0.0.11 for CentOS/Redhat and CUDA 10.2 tar package
TensorRT 7.0 For Windows
Windows ZIP Package
TensorRT is also available on the following NVIDIA GPU platforms:ubuntu
- NVIDIA GPU Cloud (NGC) TensorRT Container for cloud deployment
- NVIDIA Jetpack for Jetson embedded platforms
- NVIDIA DriveInstall for NVIDIA DRIVE autonomous driving platform (access requires membership of the NVIDIA Drive Developer Program)
=====================================================================================vim
二、配置環境變量bash
# cuda export LD_LIBRARY_PATH=/home/star/TensorRT/TensorRT-7.0.0.11/lib:$LD_LIBRARY_PATH export CUDA_INSTALL_DIR=/usr/local/cuda-10.1 export CUDNN_INSTALL_DIR=/usr/local/cuda-10.1
(wind1) star@xmatrix:~/TensorRT/TensorRT/build$ (wind1) star@xmatrix:~/TensorRT/TensorRT/build$ (wind1) star@xmatrix:~/TensorRT/TensorRT/build$ (wind1) star@xmatrix:~/TensorRT/TensorRT/build$ (wind1) star@xmatrix:~/TensorRT/TensorRT/build$ (wind1) star@xmatrix:~/TensorRT/TensorRT/build$ (wind1) star@xmatrix:~/TensorRT/TensorRT/build$ (wind1) star@xmatrix:~/TensorRT/TensorRT/build$ vim ~/.bashrc (wind1) star@xmatrix:~/TensorRT/TensorRT/build$ (wind1) star@xmatrix:~/TensorRT/TensorRT/build$ (wind1) star@xmatrix:~/TensorRT/TensorRT/build$ (wind1) star@xmatrix:~/TensorRT/TensorRT/build$ (wind1) star@xmatrix:~/TensorRT/TensorRT/build$ (wind1) star@xmatrix:~/TensorRT/TensorRT/build$ (wind1) star@xmatrix:~/TensorRT/TensorRT/build$ cat ~/.bashrc # ~/.bashrc: executed by bash(1) for non-login shells. # see /usr/share/doc/bash/examples/startup-files (in the package bash-doc) # for examples # If not running interactively, don't do anything case $- in *i*) ;; *) return;; esac # don't put duplicate lines or lines starting with space in the history. # See bash(1) for more options HISTCONTROL=ignoreboth # append to the history file, don't overwrite it shopt -s histappend # for setting history length see HISTSIZE and HISTFILESIZE in bash(1) HISTSIZE=1000 HISTFILESIZE=2000 # check the window size after each command and, if necessary, # update the values of LINES and COLUMNS. shopt -s checkwinsize # If set, the pattern "**" used in a pathname expansion context will # match all files and zero or more directories and subdirectories. #shopt -s globstar # make less more friendly for non-text input files, see lesspipe(1) [ -x /usr/bin/lesspipe ] && eval "$(SHELL=/bin/sh lesspipe)" # set variable identifying the chroot you work in (used in the prompt below) if [ -z "${debian_chroot:-}" ] && [ -r /etc/debian_chroot ]; then debian_chroot=$(cat /etc/debian_chroot) fi # set a fancy prompt (non-color, unless we know we "want" color) case "$TERM" in xterm-color|*-256color) color_prompt=yes;; esac # uncomment for a colored prompt, if the terminal has the capability; turned # off by default to not distract the user: the focus in a terminal window # should be on the output of commands, not on the prompt #force_color_prompt=yes if [ -n "$force_color_prompt" ]; then if [ -x /usr/bin/tput ] && tput setaf 1 >&/dev/null; then # We have color support; assume it's compliant with Ecma-48 # (ISO/IEC-6429). (Lack of such support is extremely rare, and such # a case would tend to support setf rather than setaf.) color_prompt=yes else color_prompt= fi fi if [ "$color_prompt" = yes ]; then PS1='${debian_chroot:+($debian_chroot)}\[\033[01;32m\]\u@\h\[\033[00m\]:\[\033[01;34m\]\w\[\033[00m\]\$ ' else PS1='${debian_chroot:+($debian_chroot)}\u@\h:\w\$ ' fi unset color_prompt force_color_prompt # If this is an xterm set the title to user@host:dir case "$TERM" in xterm*|rxvt*) PS1="\[\e]0;${debian_chroot:+($debian_chroot)}\u@\h: \w\a\]$PS1" ;; *) ;; esac # enable color support of ls and also add handy aliases if [ -x /usr/bin/dircolors ]; then test -r ~/.dircolors && eval "$(dircolors -b ~/.dircolors)" || eval "$(dircolors -b)" alias ls='ls --color=auto' #alias dir='dir --color=auto' #alias vdir='vdir --color=auto' alias grep='grep --color=auto' alias fgrep='fgrep --color=auto' alias egrep='egrep --color=auto' fi # colored GCC warnings and errors #export GCC_COLORS='error=01;31:warning=01;35:note=01;36:caret=01;32:locus=01:quote=01' # some more ls aliases alias ll='ls -alF' alias la='ls -A' alias l='ls -CF' # Add an "alert" alias for long running commands. Use like so: # sleep 10; alert alias alert='notify-send --urgency=low -i "$([ $? = 0 ] && echo terminal || echo error)" "$(history|tail -n1|sed -e '\''s/^\s*[0-9]\+\s*//;s/[;&|]\s*alert$//'\'')"' # Alias definitions. # You may want to put all your additions into a separate file like # ~/.bash_aliases, instead of adding them here directly. # See /usr/share/doc/bash-doc/examples in the bash-doc package. if [ -f ~/.bash_aliases ]; then . ~/.bash_aliases fi # enable programmable completion features (you don't need to enable # this, if it's already enabled in /etc/bash.bashrc and /etc/profile # sources /etc/bash.bashrc). if ! shopt -oq posix; then if [ -f /usr/share/bash-completion/bash_completion ]; then . /usr/share/bash-completion/bash_completion elif [ -f /etc/bash_completion ]; then . /etc/bash_completion fi fi # Anaconda 2019-12-22 export PATH=$PATH:/home/star/anaconda3/bin # cuda export LD_LIBRARY_PATH=/home/star/TensorRT/TensorRT-7.0.0.11/lib:$LD_LIBRARY_PATH export CUDA_INSTALL_DIR=/usr/local/cuda-10.1 export CUDNN_INSTALL_DIR=/usr/local/cuda-10.1 (wind1) star@xmatrix:~/TensorRT/TensorRT/build$ (wind1) star@xmatrix:~/TensorRT/TensorRT/build$ (wind1) star@xmatrix:~/TensorRT/TensorRT/build$ (wind1) star@xmatrix:~/TensorRT/TensorRT/build$ (wind1) star@xmatrix:~/TensorRT/TensorRT/build$ (wind1) star@xmatrix:~/TensorRT/TensorRT/build$
----------------------------------------------------------------------------------------------app
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11$ cd python
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/python$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/python$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/python$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/python$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/python$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/python$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/python$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/python$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/python$ ls
tensorrt-7.0.0.11-cp27-none-linux_x86_64.whl tensorrt-7.0.0.11-cp36-none-linux_x86_64.whl
tensorrt-7.0.0.11-cp34-none-linux_x86_64.whl tensorrt-7.0.0.11-cp37-none-linux_x86_64.whl
tensorrt-7.0.0.11-cp35-none-linux_x86_64.whl
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/python$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/python$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/python$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/python$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/python$ pip3 --version
pip 19.3.1 from /usr/local/lib/python3.5/dist-packages/pip (python 3.5)
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/python$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/python$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/python$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/python$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/python$ sudo pip3 install tensorrt-7.0.0.11-cp35-none-linux_x86_64.whl
[sudo] password for star:
WARNING: The directory '/home/star/.cache/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.
WARNING: The directory '/home/star/.cache/pip' or its parent directory is not owned by the current user and caching wheels has been disabled. check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.
Processing ./tensorrt-7.0.0.11-cp35-none-linux_x86_64.whl
Installing collected packages: tensorrt
Successfully installed tensorrt-7.0.0.11
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/python$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/python$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/python$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/python$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/python$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/python$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/python$ python3
Python 3.5.2 (default, Oct 8 2019, 13:06:37)
[GCC 5.4.0 20160609] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>>
>>> import tensorrt
>>> #導入tensorrt發現不報錯
>>> exit();
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/python$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/python$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/python$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/python$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/python$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/python$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/python$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/python$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/python$ cd ../
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11$ ls
bin data doc graphsurgeon include lib python samples targets TensorRT-Release-Notes.pdf uff
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11$ cd uff
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/uff$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/uff$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/uff$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/uff$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/uff$ ls
uff-0.6.5-py2.py3-none-any.whl
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/uff$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/uff$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/uff$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/uff$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/uff$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/uff$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/uff$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/uff$ sudo pip3 install uff-0.6.5-py2.py3-none-any.whl
WARNING: The directory '/home/star/.cache/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.
WARNING: The directory '/home/star/.cache/pip' or its parent directory is not owned by the current user and caching wheels has been disabled. check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.
Processing ./uff-0.6.5-py2.py3-none-any.whl
Requirement already satisfied: protobuf>=3.3.0 in /home/star/.local/lib/python3.5/site-packages (from uff==0.6.5) (3.7.1)
Requirement already satisfied: numpy>=1.11.0 in /home/star/.local/lib/python3.5/site-packages (from uff==0.6.5) (1.16.3)
Requirement already satisfied: six>=1.9 in /home/star/.local/lib/python3.5/site-packages (from protobuf>=3.3.0->uff==0.6.5) (1.12.0)
Requirement already satisfied: setuptools in /home/star/.local/lib/python3.5/site-packages (from protobuf>=3.3.0->uff==0.6.5) (41.0.1)
Installing collected packages: uff
Successfully installed uff-0.6.5
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/uff$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/uff$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/uff$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/uff$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/uff$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/uff$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/uff$ which convert-to-uff
/usr/local/bin/convert-to-uff
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/uff$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/uff$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/uff$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/uff$ python3
Python 3.5.2 (default, Oct 8 2019, 13:06:37)
[GCC 5.4.0 20160609] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>>
>>>
>>> import tensorrt
>>> tensorrt.__version__
'7.0.0.11'
>>>
>>> exit();
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/uff$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/uff$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/uff$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/uff$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/uff$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/uff$
star@xmatrix:~/TensorRT/TensorRT-7.0.0.11/uff$
配置成功less
參考：https://blog.csdn.net/calmuse/article/details/93616720
- 1. ubuntu安裝tensorrt
- 2. （原）Ubuntu安裝TensorRT
- 3. 移植jetson-inference的TensorRT到ubuntu 16.04
- 4. 【TensorRT】tensorRT 7.0的安裝配置
- 5. tensorRT+windows
- 6. TensorRT 介紹
- 7. 【linux】查看TensorRT版本
- 8. Google Colab上安裝TensorRT
- 9. TensorRT&Sample&Python[end_to_end_tensorflow_mnist]
- 10. TensorRT&Sample&Python[introductory_parser_samples]
- 更多相關文章...
- • Docker 安裝 Ubuntu - Docker教程
- • Ubuntu Docker 安裝 - Docker教程
- • Docker容器實戰(七) - 容器眼光下的文件系統
- • Docker容器實戰(六) - 容器的隔離與限制
-
每一个你不满意的现在，都有一个你没有努力的曾经。
- 1. Duang!超快Wi-Fi來襲
- 2. 機器學習-補充03 神經網絡之**函數(Activation Function)
- 3. git上開源maven項目部署 多module maven項目（多module maven+redis+tomcat+mysql）後臺部署流程學習記錄
- 4. ecliple-tomcat部署maven項目方式之一
- 5. eclipse新導入的項目經常可以看到「XX cannot be resolved to a type」的報錯信息
- 6. Spark RDD的依賴於DAG的工作原理
- 7. VMware安裝CentOS-8教程詳解
- 8. YDOOK：Java 項目 Spring 項目導入基本四大 jar 包 導入依賴，怎樣在 IDEA 的項目結構中導入 jar 包 導入依賴
- 9. 簡單方法使得putty（windows10上）可以免密登錄樹莓派
- 10. idea怎麼用本地maven
- 1. ubuntu安裝tensorrt
- 2. （原）Ubuntu安裝TensorRT
- 3. 移植jetson-inference的TensorRT到ubuntu 16.04
- 4. 【TensorRT】tensorRT 7.0的安裝配置
- 5. tensorRT+windows
- 6. TensorRT 介紹
- 7. 【linux】查看TensorRT版本
- 8. Google Colab上安裝TensorRT
- 9. TensorRT&Sample&Python[end_to_end_tensorflow_mnist]
- 10. TensorRT&Sample&Python[introductory_parser_samples]