parquet.hadoop

Class ParquetOutputCommitter

java.lang.Object

org.apache.hadoop.mapreduce.OutputCommitter

org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter

parquet.hadoop.ParquetOutputCommitter

public class ParquetOutputCommitter
extends org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter

Field Summary

Fields inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter

FILEOUTPUTCOMMITTER_ALGORITHM_VERSION, FILEOUTPUTCOMMITTER_ALGORITHM_VERSION_DEFAULT, PENDING_DIR_NAME, SUCCEEDED_FILE_NAME, SUCCESSFUL_JOB_OUTPUT_DIR_MARKER, TEMP_DIR_NAME

Constructor Summary

Constructors

Constructor and Description
ParquetOutputCommitter(org.apache.hadoop.fs.Path outputPath, org.apache.hadoop.mapreduce.TaskAttemptContext context)

Method Summary

Methods

Modifier and Type	Method and Description
void	commitJob(org.apache.hadoop.mapreduce.JobContext jobContext)

Methods inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter

abortJob, abortTask, abortTask, cleanupJob, commitTask, commitTask, getCommittedTaskPath, getCommittedTaskPath, getCommittedTaskPath, getJobAttemptPath, getJobAttemptPath, getJobAttemptPath, getTaskAttemptPath, getTaskAttemptPath, getWorkPath, isRecoverySupported, needsTaskCommit, needsTaskCommit, recoverTask, setupJob, setupTask

Methods inherited from class org.apache.hadoop.mapreduce.OutputCommitter

isRecoverySupported

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ParquetOutputCommitter

public ParquetOutputCommitter(org.apache.hadoop.fs.Path outputPath,
                      org.apache.hadoop.mapreduce.TaskAttemptContext context)
                       throws IOException

Throws:

IOException

Method Detail

commitJob

public void commitJob(org.apache.hadoop.mapreduce.JobContext jobContext)
               throws IOException

Overrides:

commitJob in class org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter

Throws:

IOException