#spark-upgrade-recovery

Checkpoint Restoration vs Metastore Rollback for Upgrade Recovery

When a Spark upgrade fails and the driver process crashes mid-transition, the platform must decide whether to restore from the last persisted checkpoint or roll back the Spark SQL metastore and configuration to a pre-upgrade snapshot. Both approaches are documented recovery paths, but they address different data integrity concerns and operate under conflicti