Navigating the Lineage mode
Using the Lineage mode to document our pipeline.
Overview
Let's step back and see what we've accomplished. With Y42's Lineage view, we get a clear, single-pane overview of our data pipeline. It shows how each part of your pipeline is connected, the status of models, and relevant metadata. This helps us manage and comprehend our pipeline effortlessly, even as it continues to grow.
Instructions
Using the Lineage mode
- Switch to the Lineage mode in the top left corner by clicking on the
Lineagedropdown - Take a look at your pipeline, you should see your three source tables generated using the Google Sheet data loader and the
stg_ordersandstg_paymentstables. - Click on
Show Columns (4)in thestg_ordersnode to view all table columns. - Open the Catalog sidebar on the right to view more metadata.
- Verify the status of the model
- Click on the
No Statusdropdown in the top right. - Select
Verified
- Click on the
Commit your changes
- Click on the
Commit & Pushbutton at the top - Add a commit name:
verifying stg_orders table - Click on Commit
- Wait for the pre-configured checks
Up next
Now that you understand how to utilize Lineage mode for a comprehensive visualization of your entire data pipeline, let's add the last part of our pipeline.