Build mxnet-tensorrt on jetson but interface changed?

zhangjiamin · May 9, 2019, 5:34am

I build mxnet-tensorrt from source(v1.15.x) using USE_TENSORRT=ON flag.

but when I run the script blow:

Execute with TensorRT

print(‘Building TensorRT engine’)
os.environ[‘MXNET_USE_TENSORRT’] = ‘1’
arg_params.update(aux_params)
all_params = dict([(k, v.as_in_context(mx.gpu(0))) for k, v in arg_params.items()])
executor = mx.contrib.tensorrt.tensorrt_bind(sym, ctx=mx.gpu(0), all_params=all_params,
data=batch_shape, grad_req=‘null’, force_rebind=True)

but can’t find tensorrt_bind function.

Did the interface of tensorrt changed?

How can I fix this error?

ThomasDelteil · May 9, 2019, 9:29pm

It seems like the API has changed in current master:

github.com

apache/incubator-mxnet/blob/1c874cfc807cee755c38f6486e8e0f4d94416cd8/python/mxnet/contrib/tensorrt.py

# Licensed to the Apache Software Foundation (ASF) under one
# or more contributor license agreements.  See the NOTICE file
# distributed with this work for additional information
# regarding copyright ownership.  The ASF licenses this file
# to you under the Apache License, Version 2.0 (the
# "License"); you may not use this file except in compliance
# with the License.  You may obtain a copy of the License at
#
#   http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing,
# software distributed under the License is distributed on an
# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
# KIND, either express or implied.  See the License for the
# specific language governing permissions and limitations
# under the License.

""" Module to enable the use of TensorRT optimized graphs."""
import os

This file has been truncated. show original

The tensorrt API is being reworked to support more operator and float16 inference in tensorrt.

zhangjiamin · May 10, 2019, 1:47am

@ThomasDelteil thank you. I change to the branch where the interface is not changed.

Topic		Replies	Views
Mxnet-tensorrt result different Discussion	5	753	November 6, 2018
ValueError: shared_buffer in simple_bind must be dict or None Gluon	5	672	December 24, 2018
Use tensorRT for mxnet model Performance	4	3717	July 24, 2019
TensorRT test letnet5 onnox parser error	4	807	July 24, 2019
MXNet to ONNX to TensorRT, how to interpret trt output to match mxnet output	2	990	May 15, 2019

Build mxnet-tensorrt on jetson but interface changed?

Execute with TensorRT

Related Topics