Add RUBY_TYPED_EMBEDDABLE flag support - solution 2

[marcomd]

Description

Now the size of embeddings is static and the RUBY_TYPED_EMBEDDABLE flag is used

• the size of embeddings is static (currently 3072) and defined in two places:
  • c side is defined in ext/rag_embeddings/embedding_config.h
  • ruby side is defined in lib/rag_embeddings/config.rb

Remember to recompile the c extension after changing the size:

rake compile

Performance

bundle exec rspec spec/performance_spec.rb

Embedding creation (10000 times): 139 ms
Cosine similarity (10000 times): 157 ms
RSS: 189.45 MB
.
Memory usage delta: 61.03 MB for 10000 embeddings
.

Finished in 0.64975 seconds (files took 0.064 seconds to load)
2 examples, 0 failures

On master (w/o RUBY_TYPED_EMBEDDABLE):

Embedding creation (10000 times): 134 ms
Cosine similarity (10000 times): 166 ms
RSS: 211.5 MB
.
Memory usage delta: 55.52 MB for 10000 embeddings
.

Finished in 0.64882 seconds (files took 0.06559 seconds to load)
2 examples, 0 failures

[marcomd]

Replaced by this solution #3