hadoop - Oozie error when trying to run a workflow in Hue -


im having trouble getting oozie work on hadoop install. input appreciated i`m complete beginner in of this. use: hadoop 2.6.0 (with yarn), oozie 4.0.1, hive 1.0.0, hue 3.7.1, pig 0.12 local install run in pseudo distributed. installed tars , configured manually because sadly one-click install cloudera doesnt work in os x.

hadoop+hive seem work fine far can tell, both in cli , hue.

pig editor hue doesnt quite work yet, can access , use files hdfs error when try access hive tables hcatalog (error 2245: cannot schema loadfunc org.apache.hcatalog.pig.hcatloader).

but right more important oozie scheduler works, doesn`t. when try run example shellscript in oozie workflow error:

cannot run program "testscript.sh" (in directory "/volumes/ws2data/hadoop_hdfs/tmp/nm-local-dir/usercache/admin/appcache/application_1427878722813_0003/container_1427878722813_0003_01_000002"): error=2, no such file or directory

now im trying understand what`s happening here: hadoop trying cache in appcache dir? script? (there no i/o involved in script simple shell command)

afaik hadoop caches in directories, not oozie ,right? why wouldnt oozie able find application container? can run mapreduce jobs hive without problem, if hadoop had problem or misconfiguration concerning caching wouldnt work either?

i followed guide http://gauravkohli.com/2014/08/26/apache-oozie-installation-on-hadoop-2-4-1/ install oozie, except skipped part reconfigures pom.xml different hadoop version, because there weren`t repositories 2.6.0

i built came hadoop version 2.3.0 "mkdistro.sh -p hadoop-2 -dskiptests" , replaced libs in /libext dir ones version 2.6.0

after linked *-site.xml files hadoop/conf oozies /conf/hadoop-conf folder.

the oozie server , responsive, running simple pig script hue uses oozie works fine (with above mentioned exception).

you need specify shell script in 2 places when create shell action.

  1. shell command
  2. files

the files box tells oozie copy shell script directory created job run.


Comments

Post a Comment

Popular posts from this blog

javascript - AngularJS custom datepicker directive -

i make custom datepicker directive custom template. but have no idea how start building it... how include date data directive? i appreciate guide or give me advice work on more precisely. it might you! follow below steps html code sample: <label>birth date</label> <input type="text" ng-model="birthdate" date-options="dateoptions" custom-datepicker/> <hr/> <pre>birthdate = {{birthdate}}</pre> <script type="text/ng-template" id="custom-datepicker.html"> <div class="enhanced-datepicker"> <div class="proxied-field-wrap"> <input type="text" ui-date-format="yy-mm-dd" ng-model="ngmodel" ui-date="dateoptions"/> </div> <label> <button class="btn" type="button"><i class="icon-calendar"></i>
Read more

javascript - jQuery date picker - Disable dates after the selection from the first date picker -

<!doctype html> <html lang="en"> <head> <meta charset="utf-8"> <title>jquery ui datepicker - default functionality</title> <link rel="stylesheet" href="//code.jquery.com/ui/1.11.4/themes/smoothness/jquery-ui.css"> <script src="//code.jquery.com/jquery-1.10.2.js"></script> <script src="//code.jquery.com/ui/1.11.4/jquery-ui.js"></script> <link rel="stylesheet" href="/resources/demos/style.css"> <script> $(function () { $("#datepicker1").datepicker(); }); </script> <script> $(function () { $("#datepicker2").datepicker(); }); </script> </head> <body> <p>date 1: <input type="text" id="datepicker1"></p> <p>date 2: <input type="t
Read more