exception - Downloading large file in python error: Compressed file ended before the end-of-stream marker was reached -


i downloading compressed file internet:

with lzma.open(urllib.request.urlopen(url)) file:     line in file:         ...

after having downloaded , processed a large part of file, error:

file "/usr/lib/python3.4/lzma.py", line 225, in _fill_buffer raise eoferror("compressed file ended before " eoferror: compressed file ended before end-of-stream marker reached

i thinking might caused internet connection drops or server not responding time. if case, there anyway make keep trying, until connection reestablished, instead of throwing exception. don't think problem file, have manually downloaded many files same website manually , decompressed it. have been able download , decompress smaller files python. file trying download has compressed size of 20 gb.

from urllib.urlopen docs:

one caveat: read() method, if size argument omitted or negative, may not read until end of data stream; there no way determine entire stream socket has been read in general case.

maybe lzma.open trips on huge size/connection errors/timeout because of above.


Comments

Post a Comment

Popular posts from this blog

javascript - AngularJS custom datepicker directive -

i make custom datepicker directive custom template. but have no idea how start building it... how include date data directive? i appreciate guide or give me advice work on more precisely. it might you! follow below steps html code sample: <label>birth date</label> <input type="text" ng-model="birthdate" date-options="dateoptions" custom-datepicker/> <hr/> <pre>birthdate = {{birthdate}}</pre> <script type="text/ng-template" id="custom-datepicker.html"> <div class="enhanced-datepicker"> <div class="proxied-field-wrap"> <input type="text" ui-date-format="yy-mm-dd" ng-model="ngmodel" ui-date="dateoptions"/> </div> <label> <button class="btn" type="button"><i class="icon-calendar"></i>
Read more

javascript - jQuery date picker - Disable dates after the selection from the first date picker -

<!doctype html> <html lang="en"> <head> <meta charset="utf-8"> <title>jquery ui datepicker - default functionality</title> <link rel="stylesheet" href="//code.jquery.com/ui/1.11.4/themes/smoothness/jquery-ui.css"> <script src="//code.jquery.com/jquery-1.10.2.js"></script> <script src="//code.jquery.com/ui/1.11.4/jquery-ui.js"></script> <link rel="stylesheet" href="/resources/demos/style.css"> <script> $(function () { $("#datepicker1").datepicker(); }); </script> <script> $(function () { $("#datepicker2").datepicker(); }); </script> </head> <body> <p>date 1: <input type="text" id="datepicker1"></p> <p>date 2: <input type="t
Read more