DarkHelp does not support batch inference

[stephanecharette]

Investigate what would be needed to support batch inference.

See: AlexeyAB/darknet#7541
And: AlexeyAB/darknet#7915

[mzacri]

Hi @stephanecharette ,

Are there any updates about batch inference integration to DarkHelp?

Many thanks!

[stephanecharette]

My understanding is this is not yet fully supported in Darknet. I've not attempted to add support for this in DarkHelp.

[mzacri]

Thank you for your response @stephanecharette,

I thought maybe this feature was integrated to DarkHelp since batch support's commit of Nuzhny007 was merged to Alexey's darknet (Issue #7915). @Nuzhny007 did provide an example of how to use the API after NMS integration.

Thanks again.

[stephanecharette]

I thought I remembered seeing some follow-up issues after that saying that darknet crashes when attempting to use batch inference. I will look into it further.

[mzacri]

Hi @stephanecharette,

I have tried using darknet's Detector class for batch inference (based on @Nuzhny work). It is working fine using GPU. Using batch inference with image tiling sounds exciting (and some script to transform the learning database based on tiling config).

Thanks!