Data catalog
Learn how to use the Data Catalog.
Data catalog mode.Overview
The Data catalog is one of Y42's synced development modes. It is a UI-based approach that allows you to rapidly create, read and modify assets.
Asset defintion
Use the data catalog to write an asset's sql statement and yaml configuration. The asset's definition is divided into four sections:
-
Metadata: Add descriptions, tags and experts to give more context to the asset's data.
-
Columns: Add predefined column tests, descriptions and tags to a column.
-
Table Tests: Add predefined table tests to your asset.
-
Query: Add a sql select statement to your asset.
Assets overview
The data catalog features a panel that displays all assets, offering an overview to effectively manage your data pipeline. Within the panel, you have the following actions available:
| Icon | Action |
|---|---|
| Add Assets: Create a new model or source. | |
| Add Folders: Organize your assets into folders to maintain a more structured arrangement. The folder structure within the data catalog mirrors the folder structure in your project's directory. | |
| Sort Assets: Sort your assets alphabetically, based on their last build status or the number of rows they have. | |
| Show Properties: Choose the property you wish to display in the panel. You can showcase the assets' status, their latest build status, the number of rows they contain or if they were starred. |
