https://111qqz.com/en/tags/tensorrt/Recent content in Tensorrt on 111qqz's blogHugo -- gohugo.ioen© 2015-2026 111qqzWed, 08 Apr 2020 14:58:16 +0800https://111qqz.com/en/post/%E5%B7%A5%E7%A8%8B/cuda/2020-04-08-cuda-error-700-when-using-tensorrt-calibration/Wed, 08 Apr 2020 14:58:16 +0800https://111qqz.com/en/post/%E5%B7%A5%E7%A8%8B/cuda/2020-04-08-cuda-error-700-when-using-tensorrt-calibration/<p>背景是要把某个caffe model,转换成tensorrt的INT8 模型。 然后遇到如下报错:</p>https://111qqz.com/en/post/%E5%B7%A5%E7%A8%8B/cuda/2020-03-24-tensorrt-model-compatibility-notes/Tue, 24 Mar 2020 12:26:01 +0800https://111qqz.com/en/post/%E5%B7%A5%E7%A8%8B/cuda/2020-03-24-tensorrt-model-compatibility-notes/<h2 class="relative group">名词说明 <div id="名词说明" class="anchor"></div> <span class="absolute top-0 w-6 transition-opacity opacity-0 -start-6 not-prose group-hover:opacity-100 select-none"> <a class="text-primary-300 dark:text-neutral-700 !no-underline" href="#%e5%90%8d%e8%af%8d%e8%af%b4%e6%98%8e" aria-label="Anchor">#</a> </span> </h2> <ul> <li>CUDA. 一般来说指的是CUDA SDK. 目前经常使用的是CUDA 8.0和CUDA 10.1两个版本. 8.0和10.1都是SDK的版本号.</li> <li>CUDNN. The NVIDIA CUDA® Deep Neural Network library (cuDNN). 是一个可以为神经网络提供GPU加速的库</li> <li>compute capability. 是GPU的固有参数,可以理解为GPU的版本.越新的显卡该数值往往越高.</li> <li>tensorRT.NVIDIA TensorRT™ is an SDK for high-performance deep learning inference. 是一个深度学习推理库,旨在提供高性能的推理速度.</li> <li>plan file,也称为 engine plan. 是生成的tensorRT 模型文件.</li> </ul> <h2 class="relative group">兼容性说明 <div id="兼容性说明" class="anchor"></div> <span class="absolute top-0 w-6 transition-opacity opacity-0 -start-6 not-prose group-hover:opacity-100 select-none"> <a class="text-primary-300 dark:text-neutral-700 !no-underline" href="#%e5%85%bc%e5%ae%b9%e6%80%a7%e8%af%b4%e6%98%8e" aria-label="Anchor">#</a> </span> </h2> <p><strong>Engine plan 的兼容性依赖于GPU的compute capability 和 TensorRT 版本, 不依赖于CUDA和CUDNN版本.</strong></p>