Skip to content

Getting Started

Follow these steps to get started using torch2trt.

Note

torch2trt depends on the TensorRT Python API. On Jetson, this is included with the latest JetPack. For desktop, please follow the TensorRT Installation Guide. You may also try installing torch2trt inside one of the NGC PyTorch docker containers for Desktop or Jetson.

Install Without plugins

To install without compiling plugins, call the following

git clone https://github.com/NVIDIA-AI-IOT/torch2trt
cd torch2trt
python setup.py install

Install With plugins

To install with plugins to support some operations in PyTorch that are not natviely supported with TensorRT, call the following

Note

Please note, this currently only includes the interpolate plugin. This plugin requires PyTorch 1.3+ for serialization. 

git clone https://github.com/NVIDIA-AI-IOT/torch2trt
cd torch2trt
sudo python setup.py install --plugins