스파크 의문2의 스파크를 잃어버렸는데 excutor가 회복될까요?

881 단어 spark
추가 코드는 다음을 참조하십시오.https://github.com/xubo245/SparkLearning
Spark 의문2 spark 잃어버리면 excutor 복구되나요 Lost executor
hadoop@Master:~/cloud/testByXubo/spark/GRCH38/test2$ ./cluster.sh 
fq0.count:45850077                                                              
Method 3=> Length:321202 sum3:3.209457928E9 time:236360ms                       
[Stage 5:=============================>                          (13 + 12) / 25]16/04/17 15:11:17 ERROR TaskSchedulerImpl: Lost executor 2 on 219.219.220.149: Executor heartbeat timed out after 144594 ms
[Stage 5:=============================>                             (2 + 2) / 4]16/04/17 15:16:42 ERROR TaskSchedulerImpl: Lost executor 5 on 219.219.220.233: remote Rpc client disassociated
16/04/17 15:16:43 ERROR TaskSchedulerImpl: Lost executor 3 on 219.219.220.131: remote Rpc client disassociated

좋은 웹페이지 즐겨찾기