首页 文章

zeppelin with spark 1.5.2独立集群错误

提问于
浏览
0

我已经将Zeppelin 0.5.5二进制文件下载到了redhat 6.3实例中 . 我也成功地 Build 了火花1.5.2 . 现在,我想让zeppelin使用spark版本而不是zeppelin附带的预编译版本 .

为此,我编辑了conf / so,它只包含这条未注释的行:

export SPARK_HOME=/home/eron/spark-1.5.2/

我还编辑了zeppelin GUI,现在我已经设置了Master:

master = spark://master:7077

然后我点击重启并尝试再次阅读教程:

val bankText = sc.textFile("/mnt/zeppelin-0.5.5-incubating-bin-all/bank.csv")

org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)中的org.apache.thrift.transport.TTransportException位于org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)org .apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429)在org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318)在org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol的.java:219)在org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:69)在org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService $ Client.recv_interpret(RemoteInterpreterService.java:220)在org.apache . 位于org.apache.zeppelin.interpreter.LazyOpenInterpreter的org.apache.zeppelin.interpreter.remote.RemoteInterpreter.interpret(RemoteInterpreter.java:211)中的zeppelin.interpreter.thrift.RemoteInterpreterService $ Client.interpret(RemoteInterpreterService.java:205) . 在org.apache.zeppelin.notebook.Paragrap解释(LazyOpenInterpreter.java:93) h.jobRun(Paragraph.java:207)org.apache.zeppelin.scheduler.Job.run(Job.java:170)at org.apache.zeppelin.scheduler.RemoteScheduler $ JobRunner.run(RemoteScheduler.java:304)在java.util.concurrent.Executors $ RunnableAdapter.call(Executors.java:471)在java.util.concurrent.FutureTask.run(FutureTask.java:262)在java.util.concurrent.ScheduledThreadPoolExecutor中$ $ ScheduledFutureTask.access 201( ScheduledThreadPoolExecutor.java:178)在java.util.concurrent.ScheduledThreadPoolExecutor中$ ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)在java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)在java.util.concurrent.ThreadPoolExecutor中java.lang.Thread.run上的$ Worker.run(ThreadPoolExecutor.java:615)(Thread.java:745)

还有,干得好

sc

收益率:

java.net.ConnectException:连接被拒绝在java.net.PlainSocketImpl.socketConnect(本机方法)在java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)在java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200 )java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)的java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)at java..Socket.connect(Socket.java:579)at org.apache位于org.apache.zeppelin.interpreter.remote.ClientFactory.create的org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:51)中的.thrift.transport.TSocket.open(TSocket.java:182) (ClientFactory.java:37)org.apache.commons.pool2.BasePooledObjectFactory.makeObject(BasePooledObjectFactory.java:60)org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:861)atg . org.apache.commons.pool2.impl.Gen上的apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:435) ericObjectPool.borrowObject(GenericObjectPool.java:363)org.apache.zeppelin.interpreter.remote.RemoteInterpreterProcess.getClient(RemoteInterpreterProcess.java:139)org.apache.zeppelin.interpreter.remote.RemoteInterpreter.interpret(RemoteInterpreter.java: 192)在org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93)在org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:207)在org.apache.zeppelin.scheduler.Job .run(Job.java:170)atg.apache.zeppelin.scheduler.RemoteScheduler $ JobRunner.run(RemoteScheduler.java:304)at java.util.concurrent.Executors $ RunnableAdapter.call(Executors.java:471)at at java.util.concurrent.FutureTask.run(FutureTask.java:262)java.util.concurrent.ScheduledThreadPoolExecutor $ ScheduledFutureTask.access $ 201(ScheduledThreadPoolExecutor.java:178)java.util.concurrent.ScheduledThreadPoolExecutor $ ScheduledFutureTask.run(ScheduledThreadPoolExecutor) .java:292)在java.util.concurrent.ThreadPoolExecutor.runWorker(Thre) adPoolExecutor.java:1145)java.util.concurrent.ThreadPoolExecutor $ Worker.run(ThreadPoolExecutor.java:615)at java.lang.Thread.run(Thread.java:745)花了0秒 .

任何我做错了什么的想法?

1 回答

  • 5

    Zeppelin 0.5.5的版本不适用于任何高于1.5.0的Apache spark版本,因此您需要从github下载Zeppelin 0.6.0并使用命令“mvn clean package -Pspark-1.5 -DskipTests”Zeppelin 0.5重新编译 . 5默认情况下构建Spark 1.4 .

相关问题