Skip to content

docs: Add documentation for openlineage on-premises#27334

Draft
kdn36 wants to merge 4 commits intopola-rs:mainfrom
kdn36:docs_openlineage_mvp
Draft

docs: Add documentation for openlineage on-premises#27334
kdn36 wants to merge 4 commits intopola-rs:mainfrom
kdn36:docs_openlineage_mvp

Conversation

@kdn36
Copy link
Copy Markdown
Collaborator

@kdn36 kdn36 commented Apr 16, 2026

@github-actions github-actions bot added documentation Improvements or additions to documentation python Related to Python Polars rust Related to Rust Polars labels Apr 16, 2026
@kdn36 kdn36 marked this pull request as draft April 16, 2026 12:36
Copy link
Copy Markdown
Collaborator

@TNieuwdorp TNieuwdorp left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looking good! Got a few small remarks

## Supported facets

OpenLineage is extensible through the use of [facets](https://openlineage.io/docs/spec/facets/). In
addition to the core `RunEvent` and `DatasetEvent`, Polars supports the following facets:
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
addition to the core `RunEvent` and `DatasetEvent`, Polars supports the following facets:
addition to the core `RunEvent` and optional `DatasetEvent`, Polars supports the following facets:


![lineage jobs](../../../assets/images/lineage_demo_jobs.png)

and lists the events as collected.
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
and lists the events as collected.
and lists the collected events.

there is a better way to capture the logical identity of the dataset, e.g. when using cloud-based
prefixes for multi-file stores.

This aspect of the implementation is **unstable**.
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What's unstable about it? Do we have an idea what might change to help shape user expectations?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation python Related to Python Polars rust Related to Rust Polars

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants