Package org.apache.storm.kafka.spout
package org.apache.storm.kafka.spout
-
ClassDescriptionBased off of a given Kafka topic a ConsumerRecord came from it will be translated to a Storm tuple and emitted to a given stream.Defines how the spout seeks the offset to be used in the first poll to Kafka upon topology deployment.Func<V,
R> A simple interface to allow compatibility with non java 8 code bases.KafkaSpout<K,V> KafkaSpoutConfig<K,V> KafkaSpoutConfig defines the required configuration to connect a consumer to a consumer group, as well as the subscribing topics.This enum controls when the tuple with theConsumerRecordfor an offset is marked as processed, i.e. when the offset can be committed to Kafka.Implementation ofKafkaSpoutRetryServiceusing the exponential backoff formula.Represents the logic that manages the retrial of failed tuples.This example sets up 3 topologies to put data in Kafka via the KafkaBolt, and shows how to set up a topology that reads from some Kafka topics using the KafkaSpout.This example is similar toKafkaSpoutTopologyMainNamedTopics, but demonstrates subscribing to Kafka topics with a regex.A list of Values in a tuple that can be routed to a given stream:RecordTranslator.apply(org.apache.kafka.clients.consumer.ConsumerRecord<K, V>).The KafkaTupleListener handles state changes of a kafka tuple inside a KafkaSpout.RecordTranslator<K,V> Translate aConsumerRecordto a tuple.Singleton comparator of TopicPartitions.