Use sha as ids

[pelikhan]

so that you can skip regenerating embeddings for the same document content.

[Stevenic]

That’s a good suggestion… I’d probably cap them at 20 characters. I did some analysis and the probability of collisions using the first 20 characters of the hash are extremely low.