parquet.hadoop.codec

Class NonBlockedDecompressorStream

java.lang.Object

java.io.InputStream

org.apache.hadoop.io.compress.CompressionInputStream

org.apache.hadoop.io.compress.DecompressorStream

parquet.hadoop.codec.NonBlockedDecompressorStream

All Implemented Interfaces:

Closeable, AutoCloseable, org.apache.hadoop.fs.Seekable

public class NonBlockedDecompressorStream
extends org.apache.hadoop.io.compress.DecompressorStream

DecompressorStream class that should be used instead of the default hadoop DecompressorStream object. Hadoop's compressor adds blocking ontop of the compression codec. We don't want that since our Pages already solve the need to add blocking.

Field Summary

Fields inherited from class org.apache.hadoop.io.compress.DecompressorStream

buffer, closed, decompressor, eof

Fields inherited from class org.apache.hadoop.io.compress.CompressionInputStream

in, maxAvailableData

Constructor Summary

Constructors

Constructor and Description
NonBlockedDecompressorStream(InputStream stream, org.apache.hadoop.io.compress.Decompressor decompressor, int bufferSize)

Method Summary

Methods

Modifier and Type	Method and Description
int	read(byte[] b, int off, int len)

Methods inherited from class org.apache.hadoop.io.compress.DecompressorStream

available, checkStream, close, decompress, getCompressedData, mark, markSupported, read, reset, resetState, skip

Methods inherited from class org.apache.hadoop.io.compress.CompressionInputStream

getPos, seek, seekToNewSource

Methods inherited from class java.io.InputStream

read

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

NonBlockedDecompressorStream

public NonBlockedDecompressorStream(InputStream stream,
                            org.apache.hadoop.io.compress.Decompressor decompressor,
                            int bufferSize)
                             throws IOException

Throws:

IOException

Method Detail

read

public int read(byte[] b,
       int off,
       int len)
         throws IOException

Overrides:

read in class org.apache.hadoop.io.compress.DecompressorStream

Throws:

IOException