Skip to content

API Reference

The SparkDQ API is organized into the following subpackages:

Module Description
sparkdq.checks All data quality checks and their corresponding configurations.
sparkdq.core Core interfaces and data structures used throughout the framework.
sparkdq.engine Execution logic for data quality validation.
sparkdq.exceptions All custom exception types used within the framework.
sparkdq.management High-level coordination components for managing checks.
sparkdq.plugin Extensibility components for user-defined plugins.