[Bug]: Move away from using Langflow tweaks in langflow service in OpenRAG

[edwinjosechittilappilly]

OpenRAG Version

latest

Deployment Method

uvx (uvx openrag)

Operating System

all

Python Version

No response

Affected Area

Other

Bug Description

If we use Tweaks when updating the component and tweaks gets changed and it cause issues for backend API.

Potential Solution:

create new components / enhance the esisting comopnents to accept global vcariables example docling inpuyt ia a file instead make it as handleinput and accept a file path from a text component and use file path as gloabl variable passthrough.

Steps to Reproduce

update or change any component that uses a global variable.

Expected Behavior

ideally chanaghint he component should not cause this issue.

Actual Behavior

Updating the component or changing the component changes the component Id and tiggers the error.

Relevant Logs

Screenshots

No response

Additional Context

No response

Checklist

• I have searched existing issues to ensure this bug hasn't been reported before.
• I have provided all the requested information.

[prasanthcaibmcom]

@edwinjosechittilappilly We need to size the effort and feasibility before we commit this to GA. Can you outline an implementation plan?

[philnash]

Setting global variables in Langflow requires use of custom headers in the request. Headers are only supposed to contain ASCII and there is no agreed upon standard for encoding headers, thus Langflow doesn't currently decode headers.

I discovered this while trying to fix the issue where OpenRAG fails to ingest files with unicode characters in the filename. My fix was initially to percent encode the header, but Langflow doesn't decode it, so that isn't helpful. However, as I said, there's no standard for encoding/decoding headers, they should be ASCII.

I raised an issue with Langflow to suggest that global variables should also be set in the body of the request. I'd be interested in your take on this @edwinjosechittilappilly and if you agree, your support in getting the Langflow team to change this, ideally with the new v2/workflows endpoint.

[mpawlow]

Status Update

• 🚧 @mpawlow to follow-up with @edwinjosechittilappilly to determine the current status & final requirements for this feature

[mpawlow]

Brief Meeting Notes

• Met with @edwinjosechittilappilly
• Associated Pull Request
  • feat: Use Langflow runtime globals (replace tweaks) WIP #1025
  • Draft / Work in Progress
  • Needs modularization
• Prerequisites
  • (a) Upgrade OpenRAG to Langflow 1.8.0
    • feat: upgrade langflow version #682
  • (b) Ingestion flow optimizations to support Docling chunking component
    • Changes in ingestion flow to support docling chunking component. #900
  • (c) Langflow Tweaks work
• Pain Points
  • (a) Cloud GA
    • Incoming Authentication / Authorization related PRs
• TODO: Mike: Review draft PR to understand overview of work involved and the overall flow