I am experiencing nasty premature termination of Bzip2::Reader. I am including a test script and a data file located here:
ftp://ftp_20130926_12853:7+yd2qFhbYNF@ftp.dna.ku.dk
Notice the difference in output:
./test.rb | wc
13206 16508 952823
bzcat bzip_test.bz2 | wc
14604484 18255605 994881701
Versions:
Linux orsted 3.2.0-4-amd64 #1 SMP Debian 3.2.46-1 x86_64 GNU/Linux
ruby 1.9.2p180 (2011-02-18 revision 30909) [x86_64-linux]
bzip2-ruby (0.2.7)