Search the community

Session timezone vs explicit UTC conversion for cross-regional Spark SQL timestamp aggregation

We need to normalize timestamp strings arriving from multiple regional sources into a single UTC column for cross-region aggregation, while still producing local wall-clock outputs for regional dashboards. The source Parquet files store naive timestamp strings, and downstream sinks expect both a canonical UTC value and a region-specific display value. On Spa