eu.dnetlib.data.hadoop.hbase

Class HbaseTableFeeder

java.lang.Object

eu.dnetlib.data.hadoop.hbase.HbaseTableFeeder

Direct Known Subclasses:

HBaseDeleteFeeder, HBasePutFeeder

public abstract class HbaseTableFeeder
extends Object

The Class HbaseTableFeeder provides abstraction to ship batch operation on an HBase table

Field Summary

Fields

Modifier and Type	Field and Description
protected eu.dnetlib.data.hadoop.config.ConfigurationEnumerator	configurationEnumerator The configuration enumerator.

Constructor Summary

Constructors

Constructor and Description
HbaseTableFeeder()

Method Summary

Modifier and Type	Method and Description
protected abstract void	addOperation(List<org.apache.hadoop.hbase.client.Mutation> buffer, eu.dnetlib.data.transform.Row row) Adds the operation.
protected Iterable<eu.dnetlib.data.transform.Row>	asRows(String epr, String xsl) As rows.
int	feed(String epr, String xsl, eu.dnetlib.data.hadoop.config.ClusterName clusterName, String tableName, boolean simulation) Feed.
int	getBatchSize() Gets the batch size.
protected org.apache.hadoop.conf.Configuration	getConf(eu.dnetlib.data.hadoop.config.ClusterName clusterName) Gets the conf.
eu.dnetlib.enabling.resultset.client.ResultSetClientFactory	getResultSetClientFactory() Gets the result set client factory.
void	setBatchSize(int batchSize) Sets the batch size.
void	setResultSetClientFactory(eu.dnetlib.enabling.resultset.client.ResultSetClientFactory resultSetClientFactory) Sets the result set client factory.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

configurationEnumerator

@Autowired
protected eu.dnetlib.data.hadoop.config.ConfigurationEnumerator configurationEnumerator

The configuration enumerator.

Constructor Detail

HbaseTableFeeder

public HbaseTableFeeder()

Method Detail

addOperation

protected abstract void addOperation(List<org.apache.hadoop.hbase.client.Mutation> buffer,
                                     eu.dnetlib.data.transform.Row row)

Adds the operation.

Parameters:

buffer - the buffer

row - the row

feed

public int feed(String epr,
                String xsl,
                eu.dnetlib.data.hadoop.config.ClusterName clusterName,
                String tableName,
                boolean simulation)
         throws IOException,
                InterruptedException

Feed.

Parameters:

epr - the epr

xsl - the xsl

clusterName - the cluster name

tableName - the table name

simulation - the simulation

Returns:

the int

Throws:

IOException - Signals that an I/O exception has occurred.

InterruptedException - the interrupted exception

asRows

protected Iterable<eu.dnetlib.data.transform.Row> asRows(String epr,
                                                         String xsl)

As rows.

Parameters:

epr - the epr

xsl - the xsl

Returns:

the iterable

getConf

protected org.apache.hadoop.conf.Configuration getConf(eu.dnetlib.data.hadoop.config.ClusterName clusterName)

Gets the conf.

Parameters:

clusterName - the cluster name

Returns:

the conf

getBatchSize

public int getBatchSize()

Gets the batch size.

Returns:

the batch size

setBatchSize

public void setBatchSize(int batchSize)

Sets the batch size.

Parameters:

batchSize - the new batch size

getResultSetClientFactory

public eu.dnetlib.enabling.resultset.client.ResultSetClientFactory getResultSetClientFactory()

Gets the result set client factory.

Returns:

the result set client factory

setResultSetClientFactory

public void setResultSetClientFactory(eu.dnetlib.enabling.resultset.client.ResultSetClientFactory resultSetClientFactory)

Sets the result set client factory.

Parameters:

resultSetClientFactory - the new result set client factory