org.apache.hadoop.hive.metastore.txn

Class ValidCompactorTxnList

java.lang.Object

org.apache.hadoop.hive.common.ValidReadTxnList

org.apache.hadoop.hive.metastore.txn.ValidCompactorTxnList

All Implemented Interfaces:

org.apache.hadoop.hive.common.ValidTxnList

public class ValidCompactorTxnList
extends org.apache.hadoop.hive.common.ValidReadTxnList

And implmentation of ValidTxnList for use by the compactor. For the purposes of isTxnRangeValid(long, long) this class will view a transaction as valid if it is committed or aborted. Additionally it will return none if there are any open transactions below the max transaction given, since we don't want to compact above open transactions. For ValidReadTxnList.isTxnValid(long) it will still view a transaction as valid only if it is committed. These produce the logic we need to assure that the compactor only sees records less than the lowest open transaction when choosing which files to compact, but that it still ignores aborted records when compacting.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.hadoop.hive.common.ValidTxnList

org.apache.hadoop.hive.common.ValidTxnList.RangeResponse

Field Summary

Fields inherited from class org.apache.hadoop.hive.common.ValidReadTxnList

exceptions, highWatermark

Fields inherited from interface org.apache.hadoop.hive.common.ValidTxnList

VALID_TXNS_KEY

Constructor Summary

Constructors

Constructor and Description
ValidCompactorTxnList()
ValidCompactorTxnList(long[] exceptions, long minOpen, long highWatermark)
ValidCompactorTxnList(String value)

Method Summary

Methods

Modifier and Type	Method and Description
org.apache.hadoop.hive.common.ValidTxnList.RangeResponse	isTxnRangeValid(long minTxnId, long maxTxnId)
void	readFromString(String src)
String	writeToString()

Methods inherited from class org.apache.hadoop.hive.common.ValidReadTxnList

getHighWatermark, getInvalidTransactions, isTxnValid, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

ValidCompactorTxnList

public ValidCompactorTxnList()

ValidCompactorTxnList

public ValidCompactorTxnList(long[] exceptions,
                     long minOpen,
                     long highWatermark)

Parameters:

exceptions - list of all open and aborted transactions

minOpen - lowest open transaction

highWatermark - highest committed transaction

ValidCompactorTxnList

public ValidCompactorTxnList(String value)

Method Detail

isTxnRangeValid

public org.apache.hadoop.hive.common.ValidTxnList.RangeResponse isTxnRangeValid(long minTxnId,
                                                                       long maxTxnId)

Specified by:

isTxnRangeValid in interface org.apache.hadoop.hive.common.ValidTxnList

Overrides:

isTxnRangeValid in class org.apache.hadoop.hive.common.ValidReadTxnList

writeToString

public String writeToString()

Specified by:

writeToString in interface org.apache.hadoop.hive.common.ValidTxnList

Overrides:

writeToString in class org.apache.hadoop.hive.common.ValidReadTxnList

readFromString

public void readFromString(String src)

Specified by:

readFromString in interface org.apache.hadoop.hive.common.ValidTxnList

Overrides:

readFromString in class org.apache.hadoop.hive.common.ValidReadTxnList