Package org.gcube.documentstore.records.aggregation

Class AggregationScheduler

java.lang.Object

org.gcube.documentstore.records.aggregation.AggregationScheduler

All Implemented Interfaces:

Runnable

Direct Known Subclasses:

BufferAggregationScheduler

public abstract class AggregationScheduler
extends Object
implements Runnable

Author:

Luca Frosini (ISTI - CNR)

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
class	AggregationScheduler.ReloaderThread

Field Summary

Fields

Modifier and Type	Field	Description
static final File	AGGREGATION_PROPERTIES_FILE
static final String	AGGREGATION_SCHEDULER_TIME
static final String	BUFFER_RECORD_NUMBER
static final String	BUFFER_RECORD_TIME
protected Map<String,List<Record>>	bufferedRecords
boolean	changeConfiguration
static final String	CONFIG_DIRECTORY_NAME
static final String	FILE_NAME
protected ScheduledFuture<?>	futureFlush
protected ScheduledFuture<?>	futureReload
static final org.slf4j.Logger	logger
protected final PersistenceExecutor	persistenceExecutor
static final int	RANDOM_INIT_START
static final long	TIME_RELOAD_CONFIGURATION	The Max amount of time for reload a configuration Get from configuration
protected int	totalBufferedRecords

Constructor Summary

Constructors

Modifier	Constructor	Description
protected	AggregationScheduler(PersistenceExecutor persistenceExecutor)
protected	AggregationScheduler(PersistenceExecutor persistenceExecutor, AggregationConfiguration config)

Method Summary

Modifier and Type	Method	Description
void	aggregate(Record record, PersistenceExecutor persistenceExecutor)	Get a record and try to aggregate with other buffered Records.
protected void	aggregate(Record record, PersistenceExecutor persistenceExecutor, boolean forceFlush)
protected static AggregationConfiguration	CheckConfiguration(PersistenceBackendConfiguration configuration)
protected void	clear()
void	flush(PersistenceExecutor persistenceExecutor)
static AggregatedRecord	getAggregatedRecord(Record record)
AggregationConfiguration	getConfig()
protected PersistenceBackendConfiguration	getConfiguration()	Get Configuration (used from reload configuration)
static Properties	getPropertiesFromFile()
protected static AggregatedRecord	instantiateAggregatedRecord(Record record)
protected abstract boolean	isTimeToPersist(int maxRecordNumber, long oldRecordMaxTime)
protected void	madeAggregation(Record record)
static AggregationScheduler	newInstance(PersistenceExecutor persistenceExecutor)
static AggregationScheduler	newInstance(PersistenceExecutor persistenceExecutor, PersistenceBackendConfiguration configuration)
protected void	reallyFlush(PersistenceExecutor persistenceExecutor)
protected void	reloadConfiguration()	reloadConfiguration
void	run()
protected abstract void	schedulerSpecificClear()
void	setConfig(AggregationConfiguration newConfig)
void	shutdown()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

logger

public static final org.slf4j.Logger logger

AGGREGATION_SCHEDULER_TIME

public static final String AGGREGATION_SCHEDULER_TIME

See Also:

• Constant Field Values

BUFFER_RECORD_TIME

public static final String BUFFER_RECORD_TIME

See Also:

• Constant Field Values

BUFFER_RECORD_NUMBER

public static final String BUFFER_RECORD_NUMBER

See Also:

• Constant Field Values

RANDOM_INIT_START

public static final int RANDOM_INIT_START

See Also:

• Constant Field Values

TIME_RELOAD_CONFIGURATION

public static final long TIME_RELOAD_CONFIGURATION

The Max amount of time for reload a configuration Get from configuration

See Also:

• Constant Field Values

CONFIG_DIRECTORY_NAME

public static final String CONFIG_DIRECTORY_NAME

See Also:

• Constant Field Values

FILE_NAME

public static final String FILE_NAME

See Also:

• Constant Field Values

AGGREGATION_PROPERTIES_FILE

public static final File AGGREGATION_PROPERTIES_FILE

totalBufferedRecords

protected int totalBufferedRecords

bufferedRecords

protected Map<String,List<Record>> bufferedRecords

persistenceExecutor

protected final PersistenceExecutor persistenceExecutor

changeConfiguration

public boolean changeConfiguration

futureFlush

protected ScheduledFuture<?> futureFlush

futureReload

protected ScheduledFuture<?> futureReload

Constructor Details

AggregationScheduler

protected AggregationScheduler(PersistenceExecutor persistenceExecutor)

AggregationScheduler

protected AggregationScheduler(PersistenceExecutor persistenceExecutor,
 AggregationConfiguration config)

Method Details

newInstance

public static AggregationScheduler newInstance(PersistenceExecutor persistenceExecutor)

newInstance

public static AggregationScheduler newInstance(PersistenceExecutor persistenceExecutor,
 PersistenceBackendConfiguration configuration)
                                        throws NumberFormatException,
Exception

Throws:

NumberFormatException

Exception

instantiateAggregatedRecord

protected static AggregatedRecord instantiateAggregatedRecord(Record record)
                                                       throws Exception

Throws:

Exception

getAggregatedRecord

public static AggregatedRecord getAggregatedRecord(Record record)
                                            throws Exception

Throws:

Exception

madeAggregation

protected void madeAggregation(Record record)

flush

public void flush(PersistenceExecutor persistenceExecutor)
           throws Exception

Throws:

Exception

schedulerSpecificClear

protected abstract void schedulerSpecificClear()

clear

protected void clear()

aggregate

protected void aggregate(Record record,
 PersistenceExecutor persistenceExecutor,
 boolean forceFlush)
                  throws Exception

Throws:

Exception

reallyFlush

protected void reallyFlush(PersistenceExecutor persistenceExecutor)
                    throws Exception

Throws:

Exception

aggregate

public void aggregate(Record record,
 PersistenceExecutor persistenceExecutor)
               throws Exception

Get a record and try to aggregate with other buffered Records.

Parameters:

record - The Record

persistenceExecutor -

Throws:

Exception

isTimeToPersist

protected abstract boolean isTimeToPersist(int maxRecordNumber,
 long oldRecordMaxTime)

reloadConfiguration

protected void reloadConfiguration()

reloadConfiguration

getConfiguration

protected PersistenceBackendConfiguration getConfiguration()

Get Configuration (used from reload configuration)

Returns:

PersistenceBackendConfiguration

getPropertiesFromFile

public static Properties getPropertiesFromFile()
                                        throws IOException

Throws:

IOException

CheckConfiguration

protected static AggregationConfiguration CheckConfiguration(PersistenceBackendConfiguration configuration)
                                                      throws IOException

Throws:

IOException

getConfig

public AggregationConfiguration getConfig()

setConfig

public void setConfig(AggregationConfiguration newConfig)

run

public void run()

Specified by:

run in interface Runnable

shutdown

public void shutdown()