[Analytics Engineering] Data Quality checks in Snowflake using Data Metric Functions
Ali, Saqib docbook.xml at gmail.com
Mon Apr 1 01:52:35 UTC 2024
Data Metrics Functions (DMF) are here! DMFs allow you to automate data quality validation and monitoring in Snowflake. Snowflake has several Pre-defined DMFs like NULL_COUNT, DUPLICATE_COUNT, UNIQUE_COUNT, FRESHNESS, ROW_COUNT. If you need something more advanced, you can roll your own custom Data Metric Functions. Creating custom DMFs is as easy as creating UDFs and then attaching them to tables as follows. Sample SQL available on GitHub: https://qosf.com/data-metric-function-in-snowflake.html
Thanks, Saqib
- Previous message (by thread): [Wranglers] NULL-safe GREATEST and LEAST now available in Snowflake
- Next message (by thread): [Wranglers] Data Quality checks in Snowflake using Data Metric Functions