How to launch a long running Spark Job?

AM failover:

Relative properties :

Yarn side:

yarn.resourcemanager.am.max-attempts

yarn.am.liveness-monitor.expiry-interval-ms

Spark side:

spark.yarn.maxAppAttempts

spark.yarn.am.attemptFailuresValidityInterval

发表评论

电子邮件地址不会被公开。 必填项已用*标注