Hadoop -copyFromLocal failing to find file
I am trying to execute -copyFromLocal through oozie shell.
hadoop fs -copyFromLocal '/usr/test/test1'
'/user/hue/oozie/workspaces/shell/'
But it is failing sometimes with error
log4j:ERROR Could not find value for key log4j.appender.TLA
log4j:ERROR Could not instantiate appender named "TLA".
copyFromLocal: `/usr/test/test1': No such file or directory
Failing Oozie Launcher, Main class
[org.apache.oozie.action.hadoop.ShellMain], exit code [1]
Sometimes it us working fine but sometime it is failling to copy. Please
help me to short out this problem. Thanks in advance.
The Shell action is going to be executed on one machine in the cluster so the local file might not exist there.
ReplyDeleteAs a workaround, you could manually upload the file with File Browser or look at Flume and Sqoop projects which are targeting this problem.
e.g. http://gethue.tumblr.com/post/48706198060/how-to-analyze-twitter-data-with-hue