Deployed based on TensorRT

[GuJW1998]

How can I implement deployment based on TensorRT using C++? Are there any relevant examples or tutorials available? Will there be related work in the future?

[Borda]

Consolidating TensorRT/ONNX dynamic batching discussions into #376. PR #853 is actively developing TensorRT engine inference support.

For immediate use: .export() for ONNX, then trtexec for TRT conversion.
TensorRT export documentation was added in v1.5.0.

Closing — please follow #376 for updates. Feel free to reopen if your specific use case isn't covered!