eu.dnetlib.data.mapreduce.hbase.oai.utils

Class RecordFieldsExtractor

java.lang.Object

eu.dnetlib.data.mapreduce.hbase.oai.utils.RecordFieldsExtractor

public class RecordFieldsExtractor
extends Object

An instance of this class can parse an XML record and extract the information needed to store the record in a publisher store.

Author:

alessia

Constructor Summary

Constructors

Constructor and Description
RecordFieldsExtractor()
RecordFieldsExtractor(List<PublisherField> storeIndices)

Method Summary

Modifier and Type	Method and Description
com.google.common.collect.Multimap<String,String>	extractFields(String record, Collection<String> enrichmentXPaths) Parses the record and returns a map where a key is the name of an index, the value is the value in the record at the xpath specificed in this.storeIndices.
String	getDuplicateXPath()
Collection<String>	getEnrichedSets(org.dom4j.Document docBody, Collection<String> enrichmentXPaths, Collection<String> originalSets)
List<PublisherField>	getStoreIndices()
boolean	isDuplicate(org.dom4j.Document doc)
boolean	isSkipDuplicates()
void	setDuplicateXPath(String duplicateXPath)
void	setSkipDuplicates(boolean skipDuplicates)
void	setStoreIndices(List<PublisherField> storeIndices)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

RecordFieldsExtractor

public RecordFieldsExtractor(List<PublisherField> storeIndices)

RecordFieldsExtractor

public RecordFieldsExtractor()

Method Detail

extractFields

public com.google.common.collect.Multimap<String,String> extractFields(String record,
                                                                       Collection<String> enrichmentXPaths)

Parses the record and returns a map where a key is the name of an index, the value is the value in the record at the xpath specificed in this.storeIndices. The enrichment xpaths are used to generate additional OAI sets that can be used by providers to get the subset of records enriched by OpenAIRE.

Parameters:

record - the XML string to parse.

enrichmentXPaths - collection of xpaths that must be satisfied to consider the current record as "enriched by OpenAIRE"

Returns:

a Multimap describing the values to be indexed for this record.

getEnrichedSets

public Collection<String> getEnrichedSets(org.dom4j.Document docBody,
                                          Collection<String> enrichmentXPaths,
                                          Collection<String> originalSets)

isDuplicate

public boolean isDuplicate(org.dom4j.Document doc)

getStoreIndices

public List<PublisherField> getStoreIndices()

setStoreIndices

public void setStoreIndices(List<PublisherField> storeIndices)

getDuplicateXPath

public String getDuplicateXPath()

setDuplicateXPath

public void setDuplicateXPath(String duplicateXPath)

isSkipDuplicates

public boolean isSkipDuplicates()

setSkipDuplicates

public void setSkipDuplicates(boolean skipDuplicates)