Closed
5 of 5 issues completed
Description
Describe the proposal
Data lineage information is critical for metadata systems, OpenLineage provides an data lineage spec and useful tools to extract and store lineage information.
Task list
- design for Integrate OpenLineage in Gravitino https://docs.google.com/document/d/1Q2DEwjo03sf3RgBFyktmiVwWFG1EshBvEC1brFQ8ZSQ/edit?tab=t.0#heading=h.2zttfya3giw5
- add OpenLineage endpoint in Gravitino server
- extract Gravitino identifier in OpenLineage spark connector for Gravitino tables
- extract Gravitino identifier in OpenLineage spark connector for non Gravitino tables