Dataphin中提交Spark任务报错“Missing application resource”

问题描述

Dataphin中提交Spark任务报错“Missing application resource”。

2022-07-29 09:19:39.660 ----- Shell command logs are shown below -----
Exception in thread "main" java.lang.IllegalArgumentException: Missing application resource.
  at org.apache.spark.launcher.CommandBuilderUtils.checkArgument(CommandBuilderUtils.java:241)
  at org.apache.spark.launcher.SparkSubmitCommandBuilder.buildSparkSubmitArgs(SparkSubmitCommandBuilder.java:160)
  at org.apache.spark.launcher.SparkSubmitCommandBuilder.buildSparkSubmitCommand(SparkSubmitCommandBuilder.java:274)
  at org.apache.spark.launcher.SparkSubmitCommandBuilder.buildCommand(SparkSubmitCommandBuilder.java:151)
  at org.apache.spark.launcher.Main.main(Main.java:86)
2022-07-29 09:19:40.926 No outputData produced.

2022-07-29 09:19:40.916 Shell command exit with code: 1

2022-07-29 09:19:40.967 =================================================================

2022-07-29 09:19:40.967 Current task status: FAILED
2022-07-29 09:19:40.967 Elapsed time: 2.378 s( Estimated: 10m )

2022-07-29 09:19:40.967 ---------------- voldemort task ends ----------------

问题原因

用户个人设置的问题。

解决方案

Spark任务需要写成以下形式：

适用于

• Dataphin