eu.dnetlib.data.mapreduce.hbase.broker.enrich

Class EnrichmentReducer

java.lang.Object

org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.hbase.io.ImmutableBytesWritable,org.apache.hadoop.hbase.io.ImmutableBytesWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

eu.dnetlib.data.mapreduce.hbase.broker.enrich.AbstractEnrichmentReducer

eu.dnetlib.data.mapreduce.hbase.broker.enrich.EnrichmentReducer

public class EnrichmentReducer
extends AbstractEnrichmentReducer

Created by claudio on 08/07/16.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.Reducer

org.apache.hadoop.mapreduce.Reducer.Context

Field Summary

Fields inherited from class eu.dnetlib.data.mapreduce.hbase.broker.enrich.AbstractEnrichmentReducer

dedupConf, dsBlacklist, dsTypeMap, dsTypeWhitelist, dsWhitelist, LIMIT, scaleLB, SCORE_DECIMALS, untrustedOaDsList

Constructor Summary

Constructors

Constructor and Description
EnrichmentReducer()

Method Summary

Modifier and Type	Method and Description
protected String	counterGroup()
protected void	reduce(org.apache.hadoop.hbase.io.ImmutableBytesWritable key, Iterable<org.apache.hadoop.hbase.io.ImmutableBytesWritable> values, org.apache.hadoop.mapreduce.Reducer.Context context)

Methods inherited from class eu.dnetlib.data.mapreduce.hbase.broker.enrich.AbstractEnrichmentReducer

getDsTypeMap, oafDeserialiser, setup, similarity

Methods inherited from class org.apache.hadoop.mapreduce.Reducer

cleanup, run

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

EnrichmentReducer

public EnrichmentReducer()

Method Detail

counterGroup

protected String counterGroup()

Specified by:

counterGroup in class AbstractEnrichmentReducer

reduce

protected void reduce(org.apache.hadoop.hbase.io.ImmutableBytesWritable key,
                      Iterable<org.apache.hadoop.hbase.io.ImmutableBytesWritable> values,
                      org.apache.hadoop.mapreduce.Reducer.Context context)
               throws IOException,
                      InterruptedException

Overrides:

reduce in class org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.hbase.io.ImmutableBytesWritable,org.apache.hadoop.hbase.io.ImmutableBytesWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Throws:

IOException

InterruptedException