java.lang.NoClassDefFoundError: org/apache/spark/sql/SparkSession开发者社区

文章/答案/技术大牛

发布

Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/spark/sql/SparkSession
        at com.thinkbiganalytics.veon.util.SparkSessionBuilder.getOrCreateSparkSession(SparkSessionBuilder.java:12)
        at com.thinkbiganalytics.veon.AbstractSparkTransformation.initSparkSession(AbstractSparkTransformation.java:92)
        at com.thinkbiganalytics.veon.transformations.SDPServiceFeeDeductionSourceToEventStore.init(SDPServiceFeeDeductionSourceToEventStore.java:57)
        at com.thinkbiganalytics.veon.AbstractSparkTransformation.doTransform(AbstractSparkTransformation.java:51)
        at com.thinkbiganalytics.veon.transformations.SDPServiceFeeDeductionSourceToEventStore.main(SDPServiceFeeDeductionSourceToEventStore.java:51)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:745)
        at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181)
        at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)
        at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)
        at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: java.lang.ClassNotFoundException: org.apache.spark.sql.SparkSession
        at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)

spark1-submit -> /Users/test/sparks/spark-1.6.2-bin-hadoop2.6/bin/spark-submit

推荐文章

爱吹牛的瀑布 · PySpark 读写 JSON 文件到 DataFrame开发者社区

2 月前

谦和的柳树 · PySpark 基础知识 - Azure Databricks | Microsoft Learn

昨天

很拉风的课本 · 零基础学VB6.0仿真：用四阶龙格库塔法计算传递函数状态方程的结果_四阶龙格库塔求解状态方程-CSDN博客

5 月前

开心的炒饭 · voxelgrid 八叉树 - CSDN文库

8 月前

仗义的沙发 · TiFF文件的DM软件处理_仪器信息网社区

9 月前

好帅的小熊猫 · pyqt5 主界面打开新主界面、打开Dialog、打开提示框的实现模板 - XJT2019 - 博客园

1 年前

斯文的烤面包 · C++ Qt开发：数据库与TableView多组件联动 - lyshark - 博客园

1 年前

问 java.lang.NoClassDefFoundError: org/apache/spark/sql/SparkSession EN

回答 10

Stack Overflow用户