OpenLineage is an open, neutrally governed standard from the LF AI & Data Foundation. It gives data teams an automated, event-based way to capture technical lineage as their jobs run, often down to the column. Support is most mature for Apache Spark, with integrations for tools such as Airflow and dbt as adoption grows. Because it is an open standard, your lineage is not locked inside one vendor’s format, so you can move it between tools as your stack changes.
Solidatus supports OpenLineage for that reason. It gives your teams flexibility and choice, and it is a strong starting point for capturing lineage inside modern data pipelines. We ingest those events and build on them.
OpenLineage captures lineage from the tools instrumented to emit it, and most producers emit that lineage as jobs run. A complete, trusted view needs more than the standard alone provides.
Data crosses mainframes, legacy systems, custom applications, and manual processes that modern-tool instrumentation does not reach.
Events describe technical movement. Stewards and auditors also need glossary terms, ownership, and policy attached to that movement.
An event stream records what happened. Regulated reporting needs a model you can roll back to a point in time and compare across versions.
Recurring jobs emit thousands of events for the same flow, and turning that stream into a clear, durable picture takes harmonization.
OpenLineage gives you automated technical lineage from your modern tools. Solidatus keeps that and adds the coverage, context, and history a regulated enterprise needs.
The connector takes column-level lineage from any platform that publishes OpenLineage events. Support is most mature for Apache Spark.
A pipeline running hourly can emit more than 700 events a month for the same flow. Solidatus consolidates those repeated job runs into one stable, versioned model of the underlying flow, and flags events that arrive without column-level detail so teams know where to add it.
Stewards and architects connect that automated lineage to the systems OpenLineage does not instrument, linking a Spark job to its mainframe source and the Power BI report it ultimately feeds. The AI Lineage Assistant speeds the work, suggesting connections from metadata patterns and extracting lineage from code and documentation.
The technical graph gains business glossary terms, ownership, data-quality scores, and regulatory policy.
The model becomes a design-time asset under Git-like version control, ready for impact analysis and audit.
Most OpenLineage producers, including Apache Spark, emit lineage events at runtime, so a flow that has not run yet stays invisible to them. Solidatus does not wait for the run. Static-analysis connectors read lineage directly from job definitions, and the AI-assisted modelling tool captures the rest, so the flow is mapped whether or not it has executed. Solidatus is the only platform with AI-assisted, design-time lineage modelling at this level of sophistication.
Apache spark and other tools that publish OpenLineage
Ingest & harmonize events
+ legacy and mainframe sources stitched in
Audit, impact analysis, lineage as code
OpenLineage events are harmonized into a versioned Solidatus model, stitched to legacy and mainframe sources, and exposed through the UI and Rest API
Once OpenLineage events are part of a governed Solidatus model, your teams can do what a technical event stream alone cannot.
Show how data flowed and was controlled at any moment in the past, for BCBS 239 and DORA, with an immutable version history.
Branch the model, simulate a change, and see the blast radius across connected systems before anything ships.
Trace from a Power BI report back through a Spark job to its mainframe source, across technical and business systems.
The full versioned model is queryable and manageable through REST APIs, so engineers can run pre-deployment impact analysis and build lineage validation into CI/CD pipelines.
OpenLineage support is a Solidatus Integration, a deep connector you configure against your existing event stream to ingest, harmonize, and model lineage. For more complex deployments, our Solutions pair that technology with discovery, implementation support, and ongoing assistance. Many organizations start with the integration and add solution services as they extend coverage to mainframes, Microsoft Purview, or other systems that need deeper configuration.