#spark-partitioning
Apache Spark Deep Dive: repartition & coalesce
The difference between repartition and coalesce, the two ways to change the number of partitions in Spark, and how each works.
Apache Spark Deep Dive: Shuffle
A look at the stages a Spark Shuffle goes through and how the number of partitions changes at each stage.