apache pig - store files based on date column -


please me.. have scenario below - input file..

id name time-stamp  1234 kiran 18-mar-2015 01:02:31 1234 kiran 18-mar-2015 01:02:31 1234 kiran 19-mar-2015 01:02:31  1234 kiran 18-mar-2015 11:02:31  1234 kiran 20-mar-2015 01:02:00 1234 kiran 11-mar-2015 21:12:31 1234 kiran 18-mar-2015 01:02:31  1234 kiran 30-mar-2015 01:02:31 1234 kiran 22-mar-2015 01:11:00 1234 kiran 30-mar-2015 01:02:31 1234 kiran 19-mar-2015 01:02:00

now need write output files based on dates in time-stamp column output be: 

user/username/date/part-m-000000

-- date variable folder name should 

user/username/18-mar-2015/part-m-000000

above file contains value on single date 

1234 kiran 18-mar-2015 01:02:31 1234 kiran 18-mar-2015 01:02:31  1234 kiran 18-mar-2015 11:02:31  1234 kiran 18-mar-2015 01:02:31

another folder name should 

user/username/19-mar-2015/part-m-000000

above file contains value on single date 

1234 kiran 19-mar-2015 01:02:31  1234 kiran 19-mar-2015 01:02:00

another folder name should 

user/username/20-mar-2015/part-m-000000

above file contains value on singe date

1234 kiran 20-mar-2015 01:02:00

another folder name should 

user/username/22-mar-2015/part-m-000000

above file contains value on singe date

1234 kiran 22-mar-2015 01:11:00

another folder name should 

user/username/30-mar-2015/part-m-000000

above file contains value on singe date

1234 kiran 30-mar-2015 01:02:31 1234 kiran 30-mar-2015 01:02:31

please me

thank you.. sree

below steps should -

  1. use date functions convert time-stamp required format.
  2. group date
  3. flatten group
  4. save result of #3 using org.apache.pig.piggybank.storage.multistorage.

Comments

Post a Comment

Popular posts from this blog

javascript - AngularJS custom datepicker directive -

i make custom datepicker directive custom template. but have no idea how start building it... how include date data directive? i appreciate guide or give me advice work on more precisely. it might you! follow below steps html code sample: <label>birth date</label> <input type="text" ng-model="birthdate" date-options="dateoptions" custom-datepicker/> <hr/> <pre>birthdate = {{birthdate}}</pre> <script type="text/ng-template" id="custom-datepicker.html"> <div class="enhanced-datepicker"> <div class="proxied-field-wrap"> <input type="text" ui-date-format="yy-mm-dd" ng-model="ngmodel" ui-date="dateoptions"/> </div> <label> <button class="btn" type="button"><i class="icon-calendar"></i>
Read more

javascript - jQuery date picker - Disable dates after the selection from the first date picker -

<!doctype html> <html lang="en"> <head> <meta charset="utf-8"> <title>jquery ui datepicker - default functionality</title> <link rel="stylesheet" href="//code.jquery.com/ui/1.11.4/themes/smoothness/jquery-ui.css"> <script src="//code.jquery.com/jquery-1.10.2.js"></script> <script src="//code.jquery.com/ui/1.11.4/jquery-ui.js"></script> <link rel="stylesheet" href="/resources/demos/style.css"> <script> $(function () { $("#datepicker1").datepicker(); }); </script> <script> $(function () { $("#datepicker2").datepicker(); }); </script> </head> <body> <p>date 1: <input type="text" id="datepicker1"></p> <p>date 2: <input type="t
Read more