databricks-spark-performance

Diagnose and fix Spark job performance bottlenecks on Databricks. Use when: slow Spark job, shuffle optimization, data skew, spill to disk, broadcast join, AQE tuning, Adaptive Query Execution, Photon evaluation, partition tuning, Spark UI interpretation, stage bottleneck, OOM, out of memory, GC pressure, task duration skew, shuffle partition count, spark.sql.shuffle.partitions, autoBroadcastJoinThreshold, redundant shuffle, unnecessary repartition, double shuffle, why is my Spark job slow, optimize Spark, performance tuning Databricks, slow stage, slow query Databricks.