2016-07-09 1 views
1

Я пытался построить Spark 1.6.2 на CentOS7 и побежал в ошибку ниже:Получение SparkFlumeProtocol и EventBatch не нашли ошибок при создании Спарк 1.6.2 на CentOS7

[error] /home/pateln16/spark-1.6.2/external/flume-sink/src/main/scala/org/apache/spark/streaming/flume/sink/SparkAvroCallbackHandler.scala:45: not found: type SparkFlumeProtocol 
[error] val transactionTimeout: Int, val backOffInterval: Int) extends SparkFlumeProtocol with Logging { 
[error]                ^
[error] /home/pateln16/spark-1.6.2/external/flume-sink/src/main/scala/org/apache/spark/streaming/flume/sink/SparkAvroCallbackHandler.scala:70: not found: type EventBatch 
[error] override def getEventBatch(n: Int): EventBatch = { 
[error]          ^
[error] /home/pateln16/spark-1.6.2/external/flume-sink/src/main/scala/org/apache/spark/streaming/flume/sink/TransactionProcessor.scala:80: not found: type EventBatch 
[error] def getEventBatch: EventBatch = { 
[error]     ^
[error] /home/pateln16/spark-1.6.2/external/flume-sink/src/main/scala/org/apache/spark/streaming/flume/sink/SparkSinkUtils.scala:25: not found: type EventBatch 
[error] def isErrorBatch(batch: EventBatch): Boolean = { 
[error]       ^
[error] /home/pateln16/spark-1.6.2/external/flume-sink/src/main/scala/org/apache/spark/streaming/flume/sink/SparkAvroCallbackHandler.scala:85: not found: type EventBatch 
[error]   new EventBatch("Spark sink has been stopped!", "", java.util.Collections.emptyList()) 
[error]   ^
[warn] Class org.jboss.netty.channel.ChannelFactory not found - continuing with a stub. 
[warn] Class org.jboss.netty.channel.ChannelFactory not found - continuing with a stub. 
[warn] Class org.jboss.netty.channel.ChannelPipelineFactory not found - continuing with a stub. 
[warn] Class org.jboss.netty.handler.execution.ExecutionHandler not found - continuing with a stub. 
[warn] Class org.jboss.netty.channel.ChannelFactory not found - continuing with a stub. 
[warn] Class org.jboss.netty.handler.execution.ExecutionHandler not found - continuing with a stub. 
[warn] Class org.jboss.netty.channel.group.ChannelGroup not found - continuing with a stub. 
[error] /home/pateln16/spark-1.6.2/external/flume-sink/src/main/scala/org/apache/spark/streaming/flume/sink/SparkSink.scala:86: not found: type SparkFlumeProtocol 
[error]  val responder = new SpecificResponder(classOf[SparkFlumeProtocol], handler.get) 

ответ

0

Я встречаюсь с такой же проблемой на Спарк 2.0.0 , Я думаю, причина в том, что файл 'external \ flume-sink \ src \ main \ avro \ sparkflume.avdl' не выполнен хорошо.

Проблема может быть решена путем:

  • Скачать Apache Avro
    http://avro.apache.org/docs/current/gettingstartedjava.html
    Я скачал все файлы фляги в папку 'C: \ Downloads \ Avro'.
  • Перейти к папке 'внешнего \ желоб мойка \ Src \ главная \ Авро'
  • компиляции sparkflume.avdl для файлов Java
    Java -jar C: \ Downloads \ Avro \ Avro-инструменты-1.8.1.jar idl sparkflume.avpr
    java -jar C: \ Downloads \ avro \ avro-tools-1.8.1.jar compile -строчный протокол sparkflume.avpr .. \ scala
  • перекомпилируйте ваши проекты.

 Смежные вопросы

  • Нет связанных вопросов^_^