Skip to content

Commit 7d9970e

Browse files
committed
Docs: Add mention of filtering BM25 matches that do not have common noun with ingredient name to docs.
1 parent 0ba8bcb commit 7d9970e

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

docs/source/explanation/foundation.rst

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -154,6 +154,8 @@ Since this is not always the case, we can combine it with the :abbr:`uSIF (Unsup
154154
12.9365: Peppers, red, cooked
155155
11.8650: Peppers, sweet, red, sauteed
156156
157+
To avoid BM25 ranking :abbr:`FDC (Food Data Central)` entries highly where they do not truly match the ingredient name, :abbr:`FDC (Food Data Central)` entries that do not share a common token with the nouns in the ingredient name are filtered out from the rankings.
158+
157159
.. hint::
158160

159161
The scores produced by BM25 have an arbitrary value, where a bigger number means more similar.

0 commit comments

Comments
 (0)