parquet.hadoop

Class ParquetRecordReader<T>

java.lang.Object

org.apache.hadoop.mapreduce.RecordReader<Void,T>

parquet.hadoop.ParquetRecordReader<T>

Type Parameters:

T - type of the materialized records

All Implemented Interfaces:

Closeable, AutoCloseable

public class ParquetRecordReader<T>
extends org.apache.hadoop.mapreduce.RecordReader<Void,T>

Reads the records from a block of a Parquet file

Author:

Julien Le Dem

See Also:

ParquetInputFormat

Constructor Summary

Constructors

Constructor and Description
ParquetRecordReader(ReadSupport<T> readSupport)
ParquetRecordReader(ReadSupport<T> readSupport, FilterCompat.Filter filter)
ParquetRecordReader(ReadSupport<T> readSupport, UnboundRecordFilter filter) Deprecated. use #ParquetRecordReader(ReadSupport, Filter)

Method Summary

Methods

Modifier and Type	Method and Description
void	close()
Void	getCurrentKey() always returns null
T	getCurrentValue()
float	getProgress()
void	initialize(org.apache.hadoop.mapreduce.InputSplit inputSplit, org.apache.hadoop.conf.Configuration configuration, org.apache.hadoop.mapred.Reporter reporter)
void	initialize(org.apache.hadoop.mapreduce.InputSplit inputSplit, org.apache.hadoop.mapreduce.TaskAttemptContext context)
boolean	nextKeyValue()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ParquetRecordReader

public ParquetRecordReader(ReadSupport<T> readSupport)

Parameters:

readSupport - Object which helps reads files of the given type, e.g. Thrift, Avro.

ParquetRecordReader

public ParquetRecordReader(ReadSupport<T> readSupport,
                   FilterCompat.Filter filter)

Parameters:

readSupport - Object which helps reads files of the given type, e.g. Thrift, Avro.

filter - for filtering individual records

ParquetRecordReader

@Deprecated
public ParquetRecordReader(ReadSupport<T> readSupport,
                              UnboundRecordFilter filter)

Deprecated. use #ParquetRecordReader(ReadSupport, Filter)

Parameters:

readSupport - Object which helps reads files of the given type, e.g. Thrift, Avro.

filter - for filtering individual records

Method Detail

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Specified by:

close in class org.apache.hadoop.mapreduce.RecordReader<Void,T>

Throws:

IOException

getCurrentKey

public Void getCurrentKey()
                   throws IOException,
                          InterruptedException

always returns null

Specified by:

getCurrentKey in class org.apache.hadoop.mapreduce.RecordReader<Void,T>

Throws:

IOException

InterruptedException

getCurrentValue

public T getCurrentValue()
                  throws IOException,
                         InterruptedException

Specified by:

getCurrentValue in class org.apache.hadoop.mapreduce.RecordReader<Void,T>

Throws:

IOException

InterruptedException

getProgress

public float getProgress()
                  throws IOException,
                         InterruptedException

Specified by:

getProgress in class org.apache.hadoop.mapreduce.RecordReader<Void,T>

Throws:

IOException

InterruptedException

initialize

public void initialize(org.apache.hadoop.mapreduce.InputSplit inputSplit,
              org.apache.hadoop.mapreduce.TaskAttemptContext context)
                throws IOException,
                       InterruptedException

Specified by:

initialize in class org.apache.hadoop.mapreduce.RecordReader<Void,T>

Throws:

IOException

InterruptedException

initialize

public void initialize(org.apache.hadoop.mapreduce.InputSplit inputSplit,
              org.apache.hadoop.conf.Configuration configuration,
              org.apache.hadoop.mapred.Reporter reporter)
                throws IOException,
                       InterruptedException

Throws:

IOException

InterruptedException

nextKeyValue

public boolean nextKeyValue()
                     throws IOException,
                            InterruptedException

Specified by:

nextKeyValue in class org.apache.hadoop.mapreduce.RecordReader<Void,T>

Throws:

IOException

InterruptedException