Container killed on request. Exit code is 143

Bug信息

WARN YarnAllocator: Container marked as failed: container_e33_1480922439133_0845_02_000002 on host: hdp4. Exit status: 143. Diagnostics: Container killed on request. Exit code is 143Container exited with a non-zero exit code 143Killed by external signal

本质原因

内�index.php/tags-41973.html" >��不足

排查问题流程

1. 增加spark参数

--conf 'spark.driver.extraJavaOptions=-XX:+UseCompressedOops -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps' \--conf 'spark.executor.extraJavaOptions=-XX:+UseCompressedOops -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintHeapAtGC  ' \

1. 观察gc日志

Heap after GC invocations=157 (full 98): PSYoungGen      total 9405