MB-62985 - Add functionality to support binary quantised vectors.

[metonymic-smokey]

1. Generalise the Add(), Ntotal(), D(), and AddWithIDs() functions to accommodate binary vector indexes.
2. Generalise the Train(), SetNProbe() functions to accommodate BIVF indexes.
3. Add the IVFDistCompute() function to perform a distance computation between a query vector and the vector corresponding to the specified ID.
4. Add functionality to read and write binary indexes into buffers.
5. Add functionality to search binary vector indexes, similar to the one offered for IVF indexes.

[metonymic-smokey]

Was changed in a recent patch so update.

[CascadingRadium]

If index is binary then calling this method would panic right as you should be calling

return C.faiss_IndexBinary_is_trained(idx.idx) != 0

https://github.com/blevesearch/faiss/blob/b3d4e00a69425b95e0b283da7801efc9f66b580d/c_api/IndexBinary_c.h#L35

[CascadingRadium]

• please add all binary index related methods(and the struct) to a new file, after splitting the interface thanks
• The method naming is off, youre just searching the binary vector with a given K - No IDs for an include selector is given, Rename to Just SearchBinary

[CascadingRadium]

code block can be reused. Add searchBinaryWithParams method similar to searchWithParams

[CascadingRadium]

Lot of code duplication here; following my earlier comment of split interfaces, you can just reuse the existing method

func WriteIndexIntoBuffer(idx BaseIndex) ([]byte, error) {
// the values to be returned by the faiss APIs
	tempBuf := (*C.uchar)(nil)
	bufSize := C.size_t(0)

	switch i := idx.(type) {
	case BinaryIndex: // Child Interface check - Will be binary index struct if has the TrainBinary method
		status = C.faiss_write_index_binary_buf(
			(*C.FaissIndexBinary)(i.(*binaryIndex).idx),
			&bufSize,
			&tempBuf,
		)
	case FloatIndex:  // Child Interface check - Will be float index struct if has the IVF methods (example
		status = C.faiss_write_index_buf(
			(*C.FaissIndex)(i.(*floatIndex).idx),
			&bufSize,
			&tempBuf,
		)
	default:
		return nil, fmt.Errorf("unsupported index type: %T", idx)
	}
// Rest of the method unchanged

[CascadingRadium]

Do not need a new method, just pass a flag, maybe expose a enum to zapx that can

type IndexType int

const (
    FloatIndexType IndexType = iota // 0
    BinaryIndexType                  // 1
)

func ReadIndexFromBuffer(buf []byte, ioflags int, idxType IndexType) () {
``