Is it possible to enable batch captioning?

[mxc19912008]

Hi,

Thanks for the repo! It is very functional!

For the caption.py, is it possible to enable batch captioning? Currently decoding is a bit slow.

Thank you!

[RoyalSkye]

Hi,

Thanks for the repo! It is very functional!

For the caption.py, is it possible to enable batch captioning? Currently decoding is a bit slow.

Thank you!

Hi,

Sorry, we don't have a plan to modify it to the batch version, since decoding is an autoregressive process based on beam search, which is hard to track and align the sizes of a batch of matrices. However, u can refer to this link: https://zhuanlan.zhihu.com/p/167072494
By the way, may multiprocessing help to speed up without redesigning the batched beam search?

Thanks.