Я использую следующий код, чтобы записать файлы в моем исходном каталоге в hdfs.Ошибка Apache Flule spoolDirectory
# Initialize agent's source, channel and sink
agent.sources = test
agent.channels = memoryChannel
agent.sinks = flumeHDFS
# Setting the source to spool directory where the file exists
agent.sources.test.type = spooldir
agent.sources.test.spoolDir = /Data
# Setting the channel to memory
agent.channels.memoryChannel.type = memory
# Max number of events stored in the memory channel
agent.channels.memoryChannel.capacity = 10000
# agent.channels.memoryChannel.batchSize = 15000
agent.channels.memoryChannel.transactioncapacity = 1000000
# Setting the sink to HDFS
agent.sinks.flumeHDFS.type = hdfs
agent.sinks.flumeHDFS.hdfs.path = /user/team
agent.sinks.flumeHDFS.hdfs.fileType = DataStream
# Write format can be text or writable
agent.sinks.flumeHDFS.hdfs.writeFormat = Text
# use a single csv file at a time
agent.sinks.flumeHDFS.hdfs.maxOpenFiles = 1
# rollover file based on maximum size of 10 MB
agent.sinks.flumeHDFS.hdfs.rollCount=0
agent.sinks.flumeHDFS.hdfs.rollInterval=2000
agent.sinks.flumeHDFS.hdfs.rollSize = 0
agent.sinks.flumeHDFS.hdfs.batchSize =1000000
# never rollover based on the number of events
agent.sinks.flumeHDFS.hdfs.rollCount = 0
# rollover file based on max time of 1 min
#agent.sinks.flumeHDFS.hdfs.rollInterval = 0
# agent.sinks.flumeHDFS.hdfs.idleTimeout = 600
# Connect source and sink with channel
agent.sources.TwitterExampleDir.channels = memoryChannel
agent.sinks.flumeHDFS.channel = memoryChannel
Но я получаю следующее сообщение об ошибке
: Не удалось настроить компонент! org.apache.flume.conf.ConfigurationException: Не удалось настроить компонент ! на org.apache.flume.conf.source.SourceConfiguration.configure (SourceConfigurati on.java:110) в org.apache.flume.conf.FlumeConfiguration $ AgentConfiguration.validateSources ( FlumeConfiguration.java:566) в орг .apache.flume.conf.FlumeConfiguration $ AgentConfiguration.isValid (FlumeCon figuration.java:345) на org.apache.flume.conf.FlumeConfiguration $ AgentConfiguration.access $ 000 (Флюм Configuration.java:212) в орг. apache.flume.conf.FlumeConfiguration.validateConfiguration (FlumeConfigur ation.java:126) at org.apache.flume.conf.FlumeConfiguration. (FlumeConfiguration.java:108) at org.apache.flume.node. PropertiesFileConfigurationProvider.getFlumeConfigurat ион (PropertiesFileConfigurationProvider.java:193) в org.apache.flume.node.AbstractConfigurationProvider.getConfiguration (Abstrac tConfigurationProvider.java:94) в org.apache.flume.node.PollingPropertiesFileConfigurationProvider $ FileWatcher Runnable. запустить (PollingPropertiesFileConfigurationProvider.java:140) в java.util.concurrent.Executors $ RunnableAdapter.call (Executors.java:511) в java.util.concurrent.FutureTask.runAndReset (FutureTask.java:308) на Java. util.concurrent.ScheduledThreadPoolExecutor $ ScheduledFutureTask.access $ 301 (ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadP oolExecutor $ ScheduledFutureTask.run (Sch eduledThreadPoolExecutor.java:294) на java.util.concurrent.ThreadPoolExecutor.runWorker (ThreadPoolExecutor.java:11 42) в java.util.concurrent.ThreadPoolExecutor $ Worker.run (ThreadPoolExecutor. java: 6 17) at java.lang.Thread.run (Thread.java:745) Вызвано: org.apache.flume.conf.ConfigurationException: для канала нет каналов. org.apache.flume.conf. source.SourceConfiguration.configure (SourceConfigurati on.java:68) ... подробнее 15
Может кто-нибудь помочь, что я должен сделать, чтобы положить мой фр данных om каталог источника/Данные для hdfs directory/user/team?