current position:Home>How to understand the shuffle process in spark?

How to understand the shuffle process in spark?

2022-02-04 16:31:51 Alibaba cloud Q & A

Spark In the middle of shuffle How should the process be understood ?




Take the answer 1:

Spark shuffle In a wide dependence , It can realize the function similar to mixed washing , Will be the same Key Distribute to the same Reducer Top processing .


copyright notice
author[Alibaba cloud Q & A],Please bring the original link to reprint, thank you.
https://en.cdmana.com/2022/02/202202041631497928.html

Random recommended