Acryl Logo
BACK TO ALL POSTS

Extracting Column-Level Lineage from SQL

Harshal Sheth

Nov 3, 2023

Extracting Column-Level Lineage from SQL


Data people really care about data lineage, particularly from SQL.

We looked at a bunch of open-source SQL automated lineage tools and found that many shared the same underlying problem: they were unaware of the underlying table schemas, and hence couldn't generate accurate column-level lineage.

A metadata management platform and data catalog like DataHub already has APIs for retrieving the schema for any tables in your data stack. So, we built a SQL lineage parser that's schema-aware and can take advantage of DataHub’s APIs to generate accurate column-level lineage from SQL queries across a wide array of dialects. More...

Click here to read the full article, posted on DataHubProject.io

NEXT UP

Snowflake and Acryl Data: Better Together for Our Users

Some partnering announcements are especially sweet—like this one.

Swaroop Jagadish

2023-10-26

Join us for Hacktoberfest 2023: Contribute to DataHub and Win Big!!!

Are you ready to dive into the world of open source and make a meaningful contribution? Hacktoberfest 2023 is here, and we're thrilled to invite you to participate by contributing to the DataHub project.

Maggie Hays

2023-10-13

Product Update - Detecting Unexpected Table Volume Changes with Acryl Observe

Learn about Volume Assertions, Acryl Observe’s solution for detecting data volume issues for tables on Snowflake, BigQuery, or Redshift, and the pivotal role it can play in keeping your data healthy.

John Joyce

2023-10-02

Get started with Acryl today.
Acryl Data delivers an easy to consume DataHub platform for the enterprise
See it in action
Acryl Data Logo
Acryl DataHub
Acryl Observe
TermsPrivacySecurity
© 2023 Acryl Data