Twitter4j.properties - I deleted this from /usr/lib/flume-ng/conf/ directory.ģ) Success bin]$. path = hdfs://localhost:8020/tweetįlume-env.sh - I have commented all the export, FLUME_CLSSPATH - In simple nothing is accessing from this file. Some corrections to my list of files mentioned in my question(nf,flume-env.sh,twitter4j.properties).I have added the below jar files to /usr/lib/flume-ng/lib/ directory. I have removed the below 3 jar files from /usr/lib/flume-ng/lib/ directory.I can stream the twitter data successfully now. I have gone through below steps and resolved the issue. = 100 flume-env.shĮxport twitter4j.streamBaseURL= Enviroment variables can be set here.Įxport JAVA_HOME=/usr/java/jdk1.7.0_67-clouderaĮxport CLASSPATH=$CLASSPATH:/FLUME_HOME/lib/* Note that the Flume conf directory is always included in the classpath.įLUME_CLASSPATH= “/usr/lib/flume-ng/lib/twitter4j-core-3.0.3.jar”įLUME_CLASSPATH=“/usr/lib/flume-ng/lib/twitter4j-media-support-3.0.3.jar”įLUME_CLASSPATH=“/usr/lib/flume-ng/lib/twitter4j-stream-3.0.3.jar”įLUME_CLASSPATH=“/usr/lib/flume-ng/lib/” twitter4j.properties = hadoop, big data, analytics, bigdata, cloudera, data science, data scientiest, business intelligence, mapreduce, data warehouse, data warehousing, mahout, hbase, nosql, newsql, businessintelligence, cloudcomputing ![]() : ()Ljava/util/Map Īt (TwitterStreamImpl.java:735)Īt .(HttpClientWrapper.java:43)Īt twitter4j.TwitterStreamImpl.(TwitterStreamImpl.java:59)Īt twitter4j.TwitterStreamFactory.(TwitterStreamFactory.java:40)Īt .nfigure(TwitterSource.java:97)Īt .nfigure(Configurables.java:41)Īt .AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:326)Īt .AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:97)Īt .PollingPropertiesFileConfigurationProvider$n(PollingPropertiesFileConfigurationProvider.java:140)Īt $RunnableAdapter.call(Executors.java:471)Īt .runAndReset(FutureTask.java:304)Īt $ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)Īt $n(ScheduledThreadPoolExecutor.java:293)Īt .runWorker(ThreadPoolExecutor.java:1145)Īt $n(ThreadPoolExecutor.java:615)Īt (Thread.java:745) nf flume-ng agent -n TwitterAgent -Dtwitter4j.streamBaseURL= -c conf -f /usr/lib/flume-ng/conf/nf Error Messageġ9/01/11 13:29:35 INFO node.AbstractConfigurationProvider: Created channel MemChannelġ9/01/11 13:29:35 INFO source.DefaultSourceFactory: Creating instance of source Twitter, type .TwitterSourceġ9/01/11 13:29:35 ERROR node.PollingPropertiesFileConfigurationProvider: Unhandled error ![]() Please see the details below and help me in solving the bin]$.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |