hadoop - Oozie error when trying to run a workflow in Hue -


im having trouble getting oozie work on hadoop install. input appreciated i`m complete beginner in of this. use: hadoop 2.6.0 (with yarn), oozie 4.0.1, hive 1.0.0, hue 3.7.1, pig 0.12 local install run in pseudo distributed. installed tars , configured manually because sadly one-click install cloudera doesnt work in os x.

hadoop+hive seem work fine far can tell, both in cli , hue.

pig editor hue doesnt quite work yet, can access , use files hdfs error when try access hive tables hcatalog (error 2245: cannot schema loadfunc org.apache.hcatalog.pig.hcatloader).

but right more important oozie scheduler works, doesn`t. when try run example shellscript in oozie workflow error:

cannot run program "testscript.sh" (in directory "/volumes/ws2data/hadoop_hdfs/tmp/nm-local-dir/usercache/admin/appcache/application_1427878722813_0003/container_1427878722813_0003_01_000002"): error=2, no such file or directory

now im trying understand what`s happening here: hadoop trying cache in appcache dir? script? (there no i/o involved in script simple shell command)

afaik hadoop caches in directories, not oozie ,right? why wouldnt oozie able find application container? can run mapreduce jobs hive without problem, if hadoop had problem or misconfiguration concerning caching wouldnt work either?

i followed guide http://gauravkohli.com/2014/08/26/apache-oozie-installation-on-hadoop-2-4-1/ install oozie, except skipped part reconfigures pom.xml different hadoop version, because there weren`t repositories 2.6.0

i built came hadoop version 2.3.0 "mkdistro.sh -p hadoop-2 -dskiptests" , replaced libs in /libext dir ones version 2.6.0

after linked *-site.xml files hadoop/conf oozies /conf/hadoop-conf folder.

the oozie server , responsive, running simple pig script hue uses oozie works fine (with above mentioned exception).

you need specify shell script in 2 places when create shell action.

  1. shell command
  2. files

the files box tells oozie copy shell script directory created job run.


Comments

Post a Comment

Popular posts from this blog

Payment information shows nothing in one page checkout page magento -

i using magento ver. 1.9.1.0 want remove shipping information , shipping method step 1 page checkout page. changed code in core file like in app\code\core\mage\checkout\block\onepage.php public function getsteps() { $steps = array(); $stepcodes = $this->_getstepcodes(); /* remove shipping address , shipping method */ $excludestep=array_diff($stepcodes,array('shipping','shipping_method')); //$excludestep=$stepcodes; if ($this->iscustomerloggedin()) { $stepcodes = array_diff($excludestep, array('login')); } foreach ($excludestep $step) { $steps[$step] = $this->getcheckout()->getstepdata($step); } return $steps; } and in app\code\core\mage\checkout\controllers\onepagecontroller.php public function savebillingaction() { if ($this->_expireajax()) { return; } if ($this->getrequest()-...
Read more

tcpdump - How to check if server received packet (acknowledged) -

Image
i running tcpdump on server capture traffic between server (servera) , remote server (serverb). not know how read output tcpdump. point out if serverb acknowledging packets being sent servera being received serverb? here tcpdump log: 2015-03-31 11:32:18.038284 ip (tos 0x0, ttl 64, id 30781, offset 0, flags [df], proto tcp (6), length 60) servera.14033 > serverb.8004: flags [s], cksum 0x02bd (correct), seq 337482636, win 14600, options [mss 1460,nop,nop,ts val 506588081 ecr 0,nop,wscale 7], length 0 0x0000: 4500 003c 783d 4000 4006 bae4 0a04 7a0e e.. servera.14033: flags [s.], cksum 0x3b2a (correct), seq 1742982091, ack 337482637, win 4140, options [mss 1380,nop,wscale 0], length 0 0x0000: 4500 0030 5ff2 0000 f606 5d3b cefd b48a e..0_.....];.... 0x0010: 0a04 7a0e 1f44 36d1 67e3 cbcb 141d 938d ..z..d6.g....... 0x0020: 7012 102c 3b2a 0000 0204 0564 0103 0300 p..,;*.....d.... 2015-03-31 11:32:18.078622 ip (tos 0x0, ttl 64, id 30782, offset 0, flags [...
Read more