Advanced
Big Data & Data Engineering
Q83 / 100
What is Spark's Adaptive Query Execution (AQE) designed to do?
Correct! Well done.
Incorrect.
The correct answer is A) Re-optimize the query plan at runtime based on actual statistics, such as dynamically switching join strategies or coalescing shuffle partitions
A
Correct Answer
Re-optimize the query plan at runtime based on actual statistics, such as dynamically switching join strategies or coalescing shuffle partitions
Explanation
AQE uses runtime statistics (actual partition sizes after a shuffle) to adapt the plan, e.g., switching a sort-merge join to a broadcast join or reducing skewed partitions.
Progress
83/100