Why is this document discarded and 0 facts extracted?

[vugenti]

I am trying to add a simple document / fact to the system - at this point just using the control plane - and can't understand the logging vs. the behavior I am experiencing. I don't know if it's a problem with my 80B model running locally, or if it's a hindsight issue, I'm hoping someone can help me get to the bottom of this.

In the control plane I add a document with the following text and leave all other fields blank / default:

The dice rolling method for character generation is 5d3+5, yielding a range of 10–20 with an average of approximately 12.5–13.0. This is the definitive rule for ability score generation in this campaign.

In the logs I observe the following:

2026-02-07 19:47:43,067 - INFO - hindsight_api.engine.retain.orchestrator - RETAIN_BATCH COMPLETE: 0 facts extracted from 1 contents in 10.348s (document tracked, no facts)

2026-02-07 19:47:43,073 - INFO - hindsight_api.engine.memory_engine - consolidation task queued for bank_id=dungeon_master, operation_id=7ec6b856-4530-4c3d-9862-218cf9a18e8f

2026-02-07 19:47:43,391 - INFO - hindsight_api.worker.poller - Worker 6261a5e95c06 claimed 1 tasks (0 consolidation): consolidation:1 (schemas: default)

2026-02-07 19:47:43,405 - INFO - hindsight_api.engine.memory_engine - [CONSOLIDATION] bank=dungeon_master completed: 0 processed

2026-02-07 19:47:43,405 - INFO - hindsight_api.engine.memory_engine - Marked async operation as completed: 7ec6b856-4530-4c3d-9862-218cf9a18e8f

BUT when I look in the Documents there is nothing there. The document was not "tracked" - it was discarded.

1. Why aren't there any facts extracted from this document? Is it a problem with my model or a hindsight issue?
2. Why is the document discarded? Is this the intended behavior?

• model Qwen3-Next-80B-A3B-Instruct
• other facts are being retained fine, like "favorite color is", or "event occurred with person" but it seems to be really struggling with this particular rule and I can't make sense of it.

[vugenti]

I got it to save by changing the text to:

User has established that the dice rolling method for character generation is 5d3+5. This is the definitive rule for ability score generation in this campaign.

It also seems weird that the entities found were "5d3+5" (not user, rule or campaign). This seems a bit off.

It really doesn't seem like this should have been necessary. Especially given that the original text is the one that was generated by the model. Can this be reproduced?

[nicoloboschi]

Hey @vugenti I've created an issue to track this problem
#324

There are 2 problems:

1. we should keep the document as tracked even if 0 facts were extracted
2. we need to investigate why it didn't like to extract those facts - likely it's model problem

[vugenti]

I was able to re-test this today using Qwen3.5-27B and on a clean bank with 0 documents, using the original text stored the facts as expectecd. Thanks!