eu.dnetlib.bioschemas.api.scraper

Class ScrapeThread

java.lang.Object

java.lang.Thread

eu.dnetlib.bioschemas.api.scraper.ScrapeThread

All Implemented Interfaces:

Runnable

public class ScrapeThread
extends Thread

See Also:

BMUSEScraper, ScrapeState

Nested Class Summary

Nested classes/interfaces inherited from class java.lang.Thread

Thread.State, Thread.UncaughtExceptionHandler

Field Summary

Fields inherited from class java.lang.Thread

MAX_PRIORITY, MIN_PRIORITY, NORM_PRIORITY

Constructor Summary

Constructors

Constructor and Description
ScrapeThread(BMUSEScraper scraper, ScrapeState scrapeState, int waitTime, int contextVersion) Sets up a thread for actually scrapping.

Method Summary

Modifier and Type	Method and Description
boolean	isFileWritten()
void	run()

Methods inherited from class java.lang.Thread

activeCount, checkAccess, clone, countStackFrames, currentThread, destroy, dumpStack, enumerate, getAllStackTraces, getContextClassLoader, getDefaultUncaughtExceptionHandler, getId, getName, getPriority, getStackTrace, getState, getThreadGroup, getUncaughtExceptionHandler, holdsLock, interrupt, interrupted, isAlive, isDaemon, isInterrupted, join, join, join, resume, setContextClassLoader, setDaemon, setDefaultUncaughtExceptionHandler, setName, setPriority, setUncaughtExceptionHandler, sleep, sleep, start, stop, stop, suspend, toString, yield

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

ScrapeThread

public ScrapeThread(BMUSEScraper scraper,
                    ScrapeState scrapeState,
                    int waitTime,
                    int contextVersion)

Sets up a thread for actually scrapping.

Parameters:

scraper - Scraper that will actually do the scraping.

scrapeState - Object that maintains state across threads.

waitTime - How long (in seconds) thread should wait after scraping page before attempting new page.

contextVersion - The context URL used is 'https://bioschemas.org/crawl/CONTEXTVERSION/ID' Where ID is the id of the CrawlRecord pulled.

Method Detail

run

public void run()

Specified by:

run in interface Runnable

Overrides:

run in class Thread

isFileWritten

public boolean isFileWritten()