Skip to content

Aggregate Checks

Aggregate checks evaluate the dataset as a whole. If an aggregate check fails, all rows are marked as invalid.

Check Description
Columns Are Complete All specified columns contain no null values.
Column Presence All required columns exist in the DataFrame.
Completeness Ratio Ratio of non-null values meets a minimum threshold.
Count Min DataFrame contains at least a minimum number of rows.
Count Max DataFrame does not exceed a maximum number of rows.
Count Between Row count falls within a defined range.
Count Exact DataFrame contains exactly the expected number of rows.
Distinct Ratio Ratio of distinct non-null values exceeds a defined threshold.
Freshness Most recent timestamp is within a defined freshness window.
Foreign Key Column values exist in a reference dataset.
Schema Check DataFrame matches an expected schema.
Unique Ratio Column maintains a minimum ratio of unique values.
Unique Rows All rows in the DataFrame are unique.