perl - How do I extract Amazon reviews from HTML? -


i have been trying write perl script scrap amazon , download product reviews have been unable so. have been using perl modules lwp::simple , html::treebuilder::xpath achieve this.

for html

<div id="revdata-dpreviewsmosthelpfulaui-r1gqhd9gmgbdxp" class="a-row a-spacing-small">   <span class="a-size-mini a-color-state a-text-bold">     verified purchase   </span>   <div class="a-section">     bought replace earlier model got lost in transit when moved. real handy helper have when making tortillas. follow recipe flour tortillas in little recipe book comes it. make few changes    </div> </div>  </div> </div>

i wanted extract product review. wrote:-

use lwp::simple;  #use html::treebuilder; use html::treebuilder::xpath;  # take asin command line. $asin = shift @argv or die "usage: perl get_reviews.pl <asin>\n";  # assemble url passed asin. $url = "http://amazon.com/o/tg/detail/-/$asin/?vi=customer-reviews";  # set unescape-html rules. quicker uri::escape. %unescape = ('&quot;'=>'"', '&amp;'=>'&', '&nbsp;'=>' '); $unescape_re = join '|' => keys %unescape;  # request url. $content = get($url); die "could not retrieve $url" unless $content; $tree = html::treebuilder::xpath->new_from_content( $content); @data = $tree->findvalues('div[@class ="a-section"]');  foreach (@data) {     print "$_\n"; }

but not getting output. can please point out mistake?

i think xpath should '//div[@class ="a-section"]' (extra // @ beginning of expression find div anywhere in html)


Comments

Post a Comment

Popular posts from this blog

javascript - AngularJS custom datepicker directive -

i make custom datepicker directive custom template. but have no idea how start building it... how include date data directive? i appreciate guide or give me advice work on more precisely. it might you! follow below steps html code sample: <label>birth date</label> <input type="text" ng-model="birthdate" date-options="dateoptions" custom-datepicker/> <hr/> <pre>birthdate = {{birthdate}}</pre> <script type="text/ng-template" id="custom-datepicker.html"> <div class="enhanced-datepicker"> <div class="proxied-field-wrap"> <input type="text" ui-date-format="yy-mm-dd" ng-model="ngmodel" ui-date="dateoptions"/> </div> <label> <button class="btn" type="button"><i class="icon-calendar"></i>
Read more

javascript - jQuery date picker - Disable dates after the selection from the first date picker -

<!doctype html> <html lang="en"> <head> <meta charset="utf-8"> <title>jquery ui datepicker - default functionality</title> <link rel="stylesheet" href="//code.jquery.com/ui/1.11.4/themes/smoothness/jquery-ui.css"> <script src="//code.jquery.com/jquery-1.10.2.js"></script> <script src="//code.jquery.com/ui/1.11.4/jquery-ui.js"></script> <link rel="stylesheet" href="/resources/demos/style.css"> <script> $(function () { $("#datepicker1").datepicker(); }); </script> <script> $(function () { $("#datepicker2").datepicker(); }); </script> </head> <body> <p>date 1: <input type="text" id="datepicker1"></p> <p>date 2: <input type="t
Read more