org.apache.storm.trident.spout

Interface IPartitionedTridentSpout.Emitter<Partitions,Partition extends ISpoutPartition,X>

All Known Implementing Classes:

KafkaTridentTransactionalSpoutEmitter, TransactionalTridentEventHubEmitter

Enclosing interface:

IPartitionedTridentSpout<Partitions,Partition extends ISpoutPartition,T>

public static interface IPartitionedTridentSpout.Emitter<Partitions,Partition extends ISpoutPartition,X>

Method Summary

Modifier and Type	Method and Description
void	close()
void	emitPartitionBatch(TransactionAttempt tx, TridentCollector collector, Partition partition, X partitionMeta) Emit a batch of tuples for a partition/transaction that has been emitted before, using the metadata created when it was first emitted.
X	emitPartitionBatchNew(TransactionAttempt tx, TridentCollector collector, Partition partition, X lastPartitionMeta) Emit a batch of tuples for a partition/transaction that’s never been emitted before.
List<Partition>	getOrderedPartitions(Partitions allPartitionInfo) Sorts given partition info to produce an ordered list of partitions
default List<Partition>	getPartitionsForTask(int taskId, int numTasks, List<Partition> allPartitionInfoSorted) Get the partitions assigned to the given task.
void	refreshPartitions(List<Partition> partitionResponsibilities) This method is called when this task is responsible for a new set of partitions.

Method Detail

getOrderedPartitions

List<Partition> getOrderedPartitions(Partitions allPartitionInfo)

Sorts given partition info to produce an ordered list of partitions

Parameters:

allPartitionInfo - The partition info for all partitions being processed by all spout tasks

Returns:

sorted list of partitions being processed by all the tasks. The ordering must be consistent for all tasks.

emitPartitionBatchNew

X emitPartitionBatchNew(TransactionAttempt tx,
                        TridentCollector collector,
                        Partition partition,
                        X lastPartitionMeta)

Emit a batch of tuples for a partition/transaction that’s never been emitted before. Return the metadata that can be used to reconstruct this partition/batch in the future.

refreshPartitions

void refreshPartitions(List<Partition> partitionResponsibilities)

This method is called when this task is responsible for a new set of partitions. Should be used to manage things like connections to brokers.

emitPartitionBatch

void emitPartitionBatch(TransactionAttempt tx,
                        TridentCollector collector,
                        Partition partition,
                        X partitionMeta)

Emit a batch of tuples for a partition/transaction that has been emitted before, using the metadata created when it was first emitted.

getPartitionsForTask

default List<Partition> getPartitionsForTask(int taskId,
                                             int numTasks,
                                             List<Partition> allPartitionInfoSorted)

Get the partitions assigned to the given task.

Parameters:

taskId - The id of the task

numTasks - The number of tasks for the spout

allPartitionInfoSorted - The partition info of all partitions being processed by all spout tasks, sorted according to getOrderedPartitions(java.lang.Object)

Returns:

The list of partitions that are to be processed by the task with taskId

close

void close()