Intermediate
Big Data & Data Engineering
Q55 / 100
What is the purpose of data validation frameworks (e.g., Great Expectations) in a pipeline?
Correct! Well done.
Incorrect.
The correct answer is A) To automatically check data against defined rules (nulls, ranges, uniqueness) and catch quality issues early
A
Correct Answer
To automatically check data against defined rules (nulls, ranges, uniqueness) and catch quality issues early
Explanation
Data validation frameworks define expectations (e.g., "column X must not be null") and run automated checks within pipelines to catch issues before they propagate.
Progress
55/100