parquet.hadoop.util

Class SerializationUtil

java.lang.Object

parquet.hadoop.util.SerializationUtil

public final class SerializationUtil
extends Object

Serialization utils copied from: https://github.com/kevinweil/elephant-bird/blob/master/core/src/main/java/com/twitter/elephantbird/util/HadoopUtils.java TODO: Refactor elephant-bird so that we can depend on utils like this without extra baggage.

Method Summary

Methods

Modifier and Type	Method and Description
static <T> T	readObjectFromConfAsBase64(String key, org.apache.hadoop.conf.Configuration conf) Reads an object (that was written using writeObjectToConfAsBase64(java.lang.String, java.lang.Object, org.apache.hadoop.conf.Configuration)) from a configuration
static void	writeObjectToConfAsBase64(String key, Object obj, org.apache.hadoop.conf.Configuration conf) Reads an object (that was written using writeObjectToConfAsBase64(java.lang.String, java.lang.Object, org.apache.hadoop.conf.Configuration)) from a configuration.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

writeObjectToConfAsBase64

public static void writeObjectToConfAsBase64(String key,
                             Object obj,
                             org.apache.hadoop.conf.Configuration conf)
                                      throws IOException

Reads an object (that was written using writeObjectToConfAsBase64(java.lang.String, java.lang.Object, org.apache.hadoop.conf.Configuration)) from a configuration.

Parameters:

key - for the configuration

conf - to read from

Throws:

IOException

readObjectFromConfAsBase64

public static <T> T readObjectFromConfAsBase64(String key,
                               org.apache.hadoop.conf.Configuration conf)
                                    throws IOException

Reads an object (that was written using writeObjectToConfAsBase64(java.lang.String, java.lang.Object, org.apache.hadoop.conf.Configuration)) from a configuration

Parameters:

key - for the configuration

conf - to read from

Returns:

the read object, or null if key is not present in conf

Throws:

IOException