Skip to content

add trt args and trt infer#180

Open
nlqq wants to merge 6 commits intomasterfrom
dev_trt_infer
Open

add trt args and trt infer#180
nlqq wants to merge 6 commits intomasterfrom
dev_trt_infer

Conversation

@nlqq
Copy link
Contributor

@nlqq nlqq commented Apr 2, 2021

No description provided.

@nlqq nlqq requested review from Ldpe2G, daquexian and ouyangyu April 2, 2021 07:07


if args.use_int8_online:
for j in range(10):
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

校准数据集的batch数可以用一个参数来控制,--calibration_batch_num

InferenceNet().get()
flow.tensorrt.cache_int8_calibration()

warmup = 2
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

warmup也需要用一个参数来控制

help='Whether to use online int8 calibration'
)
parser.add_argument(
'--use_int8_offline',
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

这里缩进和其他地方不一样

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants