API

API#

sparkdq.checks

The sparkdq.checks subpackage contains all data quality checks and their corresponding configurations.

sparkdq.core

The sparkdq.core subpackage defines the core interfaces and data structures used throughout the SparkDQ framework.

sparkdq.engine

The sparkdq.engine subpackage contains the execution logic for data quality validation.

sparkdq.exceptions

The sparkdq.exceptions subpackage defines all custom exception types used within the SparkDQ framework.

sparkdq.management

The sparkdq.management subpackage provides high-level coordination components for managing checks within the framework.

sparkdq.plugin

The sparkdq.plugin subpackage enables extensibility of the SparkDQ framework through user-defined plugins.