Spark环境下基于数据倾斜模型的Shuffle分区优化方案

阎逸飞, 王智立, 邱雪松, 王嘉潞

A Shuffle Partition Optimization Scheme Based on Data Skew Model in Spark

YAN Yi-fei, WANG Zhi-li, QIU Xue-song, WANG Jia-lu

北京邮电大学学报 . 2020, (2): 116 -121 . DOI: 10.13190/j.jbupt.2019-092