• java.lang.ClassNotFoundException: scala.runtime.java8.JFunction1$mcVI$sp

    2018. 7. 26. 17:30

    by. 위지원

    2018-07-26 17:11:37 WARN  NativeCodeLoader:62 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
    Exception in thread "main" java.lang.BootstrapMethodError: java.lang.NoClassDefFoundError: scala/runtime/java8/JFunction1$mcVI$sp
        at Quantization$.<init>(Etri.scala:22)
        at Quantization$.<clinit>(Etri.scala)
        at Quantization.main(Etri.scala)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:483)
        at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
        at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:894)
        at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:198)
        at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:228)
        at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:137)
        at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
    Caused by: java.lang.NoClassDefFoundError: scala/runtime/java8/JFunction1$mcVI$sp
        ... 13 more
    Caused by: java.lang.ClassNotFoundException: scala.runtime.java8.JFunction1$mcVI$sp
        at java.net.URLClassLoader$1.run(URLClassLoader.java:372)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:360)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        ... 13 more


    https://stackoverflow.com/questions/47172122/classnotfoundexception-scala-runtime-lambdadeserialize-when-spark-submit


    ㅋㅋㅋㅋㅋㅋㅋ scala와 spark는 서로 호환되는 버전이 있다. 그것을 잘 맞춰줘야 한다 ..ㅋㅋㅋㅋ 어이상실,,ㅎ 무지함이 낳은 참담한 결과 ^-^~~



    '2018년 > 지식' 카테고리의 다른 글

    도커로 개발환경 구축하기  (0) 2018.11.16
    에러 몇가지.,,  (0) 2018.07.30
    local yum  (0) 2018.07.26
    rpm 설치  (0) 2018.07.26
    vmware ip없을때  (0) 2018.07.26