TensorRT OSS v9.2.0
TensorRT OSS release corresponding to TensorRT 9.2.0.5 release.
Updates since TensorRT 9.1.0 release.
Key Features and Updates:
trtexec
enhancement: Added--weightless
flag to mark the engine as weightless.- Parser changes
- Added support for Hardmax operator.
- Changes to a few operator importers to ensure that TensorRT preserves the precision of operations when using strongly typed mode.
- Plugin changes
- Explicit INT8 support added to
bertQKVToContextPlugin
. - Various bug fixes.
- Explicit INT8 support added to
- Updated HuggingFace demo to use transformers v4.31.0 and PyTorch v2.1.0.