2B model

[KooSung]

Nice work! I was wondering if there are any plans to release the 2B model? If so, is there an estimated timeline for when it might be made available?

[raghavlite]

Hi.
The 2B model is released.

[KooSung]

@raghavlite Thanks! Is there a script for extracting embeddings?

[raghavlite]

Hi,
The eval_mmeb.py is fairly simple. Creates a data loader and iterates through a dataset. You should be able to repurpose your data into that format.

The exact extraction of embeddings happens here in the eval_mmeb.py script.

B3/eval_mmeb.py

Line 160 in d2773f1

encoded_tensor.append(output["qry_reps"].cpu().detach().float())

You can use this script for now.

I'm currently busy for a couple of days. I'll create a more clear script (where you can supply an image and a text) and add it to the readme by Sunday.

[zhangyongshun]

Hi, The eval_mmeb.py is fairly simple. Creates a data loader and iterates through a dataset. You should be able to repurpose your data into that format.

The exact extraction of embeddings happens here in the eval_mmeb.py script.

B3/eval_mmeb.py

Line 160 in d2773f1

encoded_tensor.append(output["qry_reps"].cpu().detach().float())
You can use this script for now.

I'm currently busy for a couple of days. I'll create a more clear script (where you can supply an image and a text) and add it to the readme by Sunday.

any update?

[raghavlite]

Sorry. I've been swamped. Will definitely do it by This tuesday.
Give it a try yourself too. It should be very easy.

[raghavlite]

Started working on this. Will take a few more days. Super sorry for all the delays.
Checkout the much simpler eval_mmeb_simple.py
Has the same functionality and is much simpler.