Editorial Note: This article is written with editorial review and topic relevance in mind.
如果 shuffle 块在 reduce 任务中本地可用,则任务可以直接从磁盘读取,绕过 shuffle 服务,这有助于减少 shuffle 期间的 rpc 连接数。 但是 spark 当前的 shuffle 机制会导致 reduce 任务.
Disney Unveils High Energy Trailer for “Shuffle of Love A Descendants