Advanced
Big Data & Data Engineering
Q98 / 100
When evolving a schema by adding a new non-nullable column to an existing large table in a lakehouse format, what is a key consideration?
Correct! Well done.
Incorrect.
The correct answer is A) Existing data files do not have the new column, so the format typically requires a default value or treats it as nullable to maintain backward read compatibility
A
Correct Answer
Existing data files do not have the new column, so the format typically requires a default value or treats it as nullable to maintain backward read compatibility
Explanation
To avoid rewriting all historical files immediately, formats handle schema evolution by reading missing columns as null or default values for older files, deferring physical rewrites.
Progress
98/100