parquet.hadoop.codec

Class NonBlockedCompressorStream

java.lang.Object

java.io.OutputStream

org.apache.hadoop.io.compress.CompressionOutputStream

org.apache.hadoop.io.compress.CompressorStream

parquet.hadoop.codec.NonBlockedCompressorStream

All Implemented Interfaces:

Closeable, Flushable, AutoCloseable

public class NonBlockedCompressorStream
extends org.apache.hadoop.io.compress.CompressorStream

CompressorStream class that should be used instead of the default hadoop CompressorStream object. Hadoop's compressor adds blocking ontop of the compression codec. We don't want that since our Pages already solve the need to add blocking.

Field Summary

Fields inherited from class org.apache.hadoop.io.compress.CompressorStream

buffer, closed, compressor

Fields inherited from class org.apache.hadoop.io.compress.CompressionOutputStream

out

Constructor Summary

Constructors

Constructor and Description
NonBlockedCompressorStream(OutputStream stream, org.apache.hadoop.io.compress.Compressor compressor, int bufferSize)

Method Summary

Methods

Modifier and Type	Method and Description
void	write(byte[] b, int off, int len)

Methods inherited from class org.apache.hadoop.io.compress.CompressorStream

close, compress, finish, resetState, write

Methods inherited from class org.apache.hadoop.io.compress.CompressionOutputStream

flush

Methods inherited from class java.io.OutputStream

write

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

NonBlockedCompressorStream

public NonBlockedCompressorStream(OutputStream stream,
                          org.apache.hadoop.io.compress.Compressor compressor,
                          int bufferSize)

Method Detail

write

public void write(byte[] b,
         int off,
         int len)
           throws IOException

Overrides:

write in class org.apache.hadoop.io.compress.CompressorStream

Throws:

IOException