Source data freshness
Monitoring source data freshenss.
Source freshness tests enable you to assess the timeliness of data in source tables. These checks are valuable for verifying the health of your upstream data before running your DAGs.
In Y42, you can configure source freshness tests using the
error_after parameter within the freshness block of a source YAML file. Providing a
loaded_at_field is mandatory for calculating freshness.
These settings are hierarchical, meaning a configuration set at the source level will apply to all tables within that source unless overridden.