Model Optimization Tasks: Stage 3

[Ishaan-Datta]

Stage 3: TensorRT Engine Conversion/Inference

• Investigate using TensorRT Engine Plugins to bake the pre/post processing into the engine file itself (with amy)
• Repair the comparison scripts under /python_wip and /conversion_tools and report on results of different methods
• For all the verify functions run them for a few random inputs and average values (warmup)
• Copy logic for comparing the prediction consistency and confidence independently using valery's functions in ONNX_verify
• MNIST Inference Example
• QuickStart Guide
• Take a look at the Google Drive for Nvidia Examples

Specific Engine Plugins/Extras for Viewing in Drive:

• crop and resize
• efficientNMS
• flattenConcat
• NMS plugin
• nvpluginfasterRCNN
• resizeNearest
• polygraphy