load_collection_and_retrieve function extremely slow

[cyh-0]

Hi,

I found running load_collection_and_retrieve function in modules/retrieve.py is extremely slow. It takes me nearly 30h to process kilt_nq with splade-v3. Is this normal?

Cheers

[DRRV]

Hi,

Can you increase the batch_size of the splade-v3 config ?

bergen/config/retriever/splade-v3.yaml

Line 5 in eb35d6e

batch_size: 64

others splade config have 512