Failed to find data source: text
生活随笔
收集整理的這篇文章主要介紹了
Failed to find data source: text
小編覺得挺不錯的,現在分享給大家,幫大家做個參考.
出現問題如下:
sing Spark's default log4j profile: org/apache/spark/log4j-defaults.properties Exception in thread "main" java.lang.ClassNotFoundException: Failed to find data source: text. Please find packages at http://spark.apache.org/third-party-projects.htmlat org.apache.spark.sql.execution.datasources.DataSource$.lookupDataSource(DataSource.scala:635)at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:190)at org.apache.spark.sql.DataFrameReader.text(DataFrameReader.scala:693)at org.apache.spark.sql.DataFrameReader.textFile(DataFrameReader.scala:732)at org.apache.spark.sql.DataFrameReader.textFile(DataFrameReader.scala:702)at RunRecommender$.main(RunRecommender.scala:36)at RunRecommender.main(RunRecommender.scala) Caused by: java.lang.ClassNotFoundException: text.DefaultSourceat java.net.URLClassLoader.findClass(URLClassLoader.java:382)at java.lang.ClassLoader.loadClass(ClassLoader.java:424)at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)at java.lang.ClassLoader.loadClass(ClassLoader.java:357)at org.apache.spark.sql.execution.datasources.DataSource$$anonfun$23$$anonfun$apply$15.apply(DataSource.scala:618)at org.apache.spark.sql.execution.datasources.DataSource$$anonfun$23$$anonfun$apply$15.apply(DataSource.scala:618)at scala.util.Try$.apply(Try.scala:192)at org.apache.spark.sql.execution.datasources.DataSource$$anonfun$23.apply(DataSource.scala:618)at org.apache.spark.sql.execution.datasources.DataSource$$anonfun$23.apply(DataSource.scala:618)at scala.util.Try.orElse(Try.scala:84)at org.apache.spark.sql.execution.datasources.DataSource$.lookupDataSource(DataSource.scala:618)... 6 more解決方案:
不要使用java -jar來運行jar
使用spark-submit來運行jar即可
總結
以上是生活随笔為你收集整理的Failed to find data source: text的全部內容,希望文章能夠幫你解決所遇到的問題。
- 上一篇: 微信公众号图片
- 下一篇: scala中_*的作用