Uses of Package
org.apache.storm.kafka.spout
Package
Description
-
ClassDescriptionA simple interface to allow compatibility with non java 8 code bases.Translate a
ConsumerRecord
to a tuple. -
ClassDescriptionBased off of a given Kafka topic a ConsumerRecord came from it will be translated to a Storm tuple and emitted to a given stream.Defines how the spout seeks the offset to be used in the first poll to Kafka upon topology deployment.A simple interface to allow compatibility with non java 8 code bases.KafkaSpoutConfig defines the required configuration to connect a consumer to a consumer group, as well as the subscribing topics.This enum controls when the tuple with the
ConsumerRecord
for an offset is marked as processed, i.e. when the offset can be committed to Kafka.Represents the logic that manages the retrial of failed tuples.This example sets up 3 topologies to put data in Kafka via the KafkaBolt, and shows how to set up a topology that reads from some Kafka topics using the KafkaSpout.A list of Values in a tuple that can be routed to a given stream:RecordTranslator.apply(org.apache.kafka.clients.consumer.ConsumerRecord<K, V>)
.The KafkaTupleListener handles state changes of a kafka tuple inside a KafkaSpout.Translate aConsumerRecord
to a tuple.Singleton comparator of TopicPartitions. -
ClassDescriptionDefines how the spout seeks the offset to be used in the first poll to Kafka upon topology deployment.A simple interface to allow compatibility with non java 8 code bases.This enum controls when the tuple with the
ConsumerRecord
for an offset is marked as processed, i.e. when the offset can be committed to Kafka.Translate aConsumerRecord
to a tuple. -
ClassDescriptionA simple interface to allow compatibility with non java 8 code bases.Translate a
ConsumerRecord
to a tuple.