apache - Hadoop client not able to connect to server -


i set 2-node hadoop cluster, , running start-df.sh , start-yarn.sh works nicely (i.e. expected services running, no errors in logs).

however, when try run application, several tasks fail:

15/04/01 15:27:53 info mapreduce.job: task id : attempt_1427894767376_0001_m_000008_2, status : failed

i checked yarn , datanode logs, nothing reported there. in userlogs, syslogs files on slave node contain following error message:

2015-04-01 15:27:21,077 info [main] org.apache.hadoop.ipc.client: retrying connect server: slave.domain.be./127.0.1.1:53834. tried 9 time(s); retry policy retryuptomaximumcountwithfixedsleep(maxretries=10, sleeptime=1000 milliseconds) 2015-04-01 15:27:21,078 warn [main] org.apache.hadoop.mapred.yarnchild: exception running child : java.net.connectexception: call slave.domain.be./127.0.1.1 slave.domain.be.:53834 failed on connection exception: java.net.connectexception: connection refused; more details see: http://wiki.apache.org/hadoop/connectionrefused @ sun.reflect.nativeconstructoraccessorimpl.newinstance0(native method)

so problem slave cannot connect itself..

i checked whether there process running on slave node listening @ port 53834, there none. however, 'expected' ports being listened on (50020,50075,..). in configuration have used port 53834. it's different port on different runs.

any ideas on fixing issue?

your error might due loopback address in hosts file. go /etc/hosts file , comment line 127.0.1.1 in slave nodes , master node(if necessary). start hadoop processes.

edited:

  1. do in terminal edit hosts file without root permission: sudo bash

  2. enter current user password enter root login. can edit hosts file using: nano /etc/hosts


Comments

Post a Comment

Popular posts from this blog

javascript - AngularJS custom datepicker directive -

i make custom datepicker directive custom template. but have no idea how start building it... how include date data directive? i appreciate guide or give me advice work on more precisely. it might you! follow below steps html code sample: <label>birth date</label> <input type="text" ng-model="birthdate" date-options="dateoptions" custom-datepicker/> <hr/> <pre>birthdate = {{birthdate}}</pre> <script type="text/ng-template" id="custom-datepicker.html"> <div class="enhanced-datepicker"> <div class="proxied-field-wrap"> <input type="text" ui-date-format="yy-mm-dd" ng-model="ngmodel" ui-date="dateoptions"/> </div> <label> <button class="btn" type="button"><i class="icon-calendar"></i>
Read more

javascript - jQuery date picker - Disable dates after the selection from the first date picker -

<!doctype html> <html lang="en"> <head> <meta charset="utf-8"> <title>jquery ui datepicker - default functionality</title> <link rel="stylesheet" href="//code.jquery.com/ui/1.11.4/themes/smoothness/jquery-ui.css"> <script src="//code.jquery.com/jquery-1.10.2.js"></script> <script src="//code.jquery.com/ui/1.11.4/jquery-ui.js"></script> <link rel="stylesheet" href="/resources/demos/style.css"> <script> $(function () { $("#datepicker1").datepicker(); }); </script> <script> $(function () { $("#datepicker2").datepicker(); }); </script> </head> <body> <p>date 1: <input type="text" id="datepicker1"></p> <p>date 2: <input type="t
Read more