org.apache.storm.eventhubs.trident

Class TransactionalTridentEventHubEmitter

java.lang.Object

org.apache.storm.eventhubs.trident.TransactionalTridentEventHubEmitter

All Implemented Interfaces:

IPartitionedTridentSpout.Emitter<Partitions,Partition,Map<String,Object>>

public class TransactionalTridentEventHubEmitter
extends Object
implements IPartitionedTridentSpout.Emitter<Partitions,Partition,Map<String,Object>>

Constructor Summary

Constructors

Constructor and Description
TransactionalTridentEventHubEmitter(EventHubSpoutConfig spoutConfig)
TransactionalTridentEventHubEmitter(EventHubSpoutConfig spoutConfig, int batchSize, ITridentPartitionManagerFactory pmFactory, IEventHubReceiverFactory recvFactory)

Method Summary

Modifier and Type	Method and Description
void	close()
void	emitPartitionBatch(TransactionAttempt attempt, TridentCollector collector, Partition partition, Map<String,Object> meta) Emit a batch of tuples for a partition/transaction that has been emitted before, using the metadata created when it was first emitted.
Map<String,Object>	emitPartitionBatchNew(TransactionAttempt attempt, TridentCollector collector, Partition partition, Map<String,Object> meta) Emit a batch of tuples for a partition/transaction that’s never been emitted before.
List<Partition>	getOrderedPartitions(Partitions partitions) Sorts given partition info to produce an ordered list of partitions.
void	refreshPartitions(List<Partition> partitionList) This method is called when this task is responsible for a new set of partitions.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.storm.trident.spout.IPartitionedTridentSpout.Emitter

getPartitionsForTask

Constructor Detail

TransactionalTridentEventHubEmitter

public TransactionalTridentEventHubEmitter(EventHubSpoutConfig spoutConfig)

TransactionalTridentEventHubEmitter

public TransactionalTridentEventHubEmitter(EventHubSpoutConfig spoutConfig,
                                           int batchSize,
                                           ITridentPartitionManagerFactory pmFactory,
                                           IEventHubReceiverFactory recvFactory)

Method Detail

close

public void close()

Specified by:

close in interface IPartitionedTridentSpout.Emitter<Partitions,Partition,Map<String,Object>>

emitPartitionBatch

public void emitPartitionBatch(TransactionAttempt attempt,
                               TridentCollector collector,
                               Partition partition,
                               Map<String,Object> meta)

Description copied from interface: IPartitionedTridentSpout.Emitter

Emit a batch of tuples for a partition/transaction that has been emitted before, using the metadata created when it was first emitted.

Specified by:

emitPartitionBatch in interface IPartitionedTridentSpout.Emitter<Partitions,Partition,Map<String,Object>>

emitPartitionBatchNew

public Map<String,Object> emitPartitionBatchNew(TransactionAttempt attempt,
                                                TridentCollector collector,
                                                Partition partition,
                                                Map<String,Object> meta)

Description copied from interface: IPartitionedTridentSpout.Emitter

Emit a batch of tuples for a partition/transaction that’s never been emitted before. Return the metadata that can be used to reconstruct this partition/batch in the future.

Specified by:

emitPartitionBatchNew in interface IPartitionedTridentSpout.Emitter<Partitions,Partition,Map<String,Object>>

getOrderedPartitions

public List<Partition> getOrderedPartitions(Partitions partitions)

Description copied from interface: IPartitionedTridentSpout.Emitter

Sorts given partition info to produce an ordered list of partitions.

Specified by:

getOrderedPartitions in interface IPartitionedTridentSpout.Emitter<Partitions,Partition,Map<String,Object>>

Parameters:

partitions - The partition info for all partitions being processed by all spout tasks

Returns:

sorted list of partitions being processed by all the tasks. The ordering must be consistent for all tasks.

refreshPartitions

public void refreshPartitions(List<Partition> partitionList)

Description copied from interface: IPartitionedTridentSpout.Emitter

This method is called when this task is responsible for a new set of partitions. Should be used to manage things like connections to brokers.

Specified by:

refreshPartitions in interface IPartitionedTridentSpout.Emitter<Partitions,Partition,Map<String,Object>>