Package org.apache.storm.perf
Class KafkaClientHdfsTopo
java.lang.Object
org.apache.storm.perf.KafkaClientHdfsTopo
This topo helps measure speed of reading from Kafka and writing to Hdfs.
Spout Reads from Kafka.
Bolt writes to Hdfs.
-
Nested Class Summary
-
Field Summary
-
Constructor Summary
-
Method Summary
-
Field Details
-
SPOUT_NUM
- See Also:
-
BOLT_NUM
- See Also:
-
KAFKA_TOPIC
- See Also:
-
KAFKA_BOOTSTRAP_HOSTS
- See Also:
-
HDFS_URI
- See Also:
-
HDFS_PATH
- See Also:
-
HDFS_BATCH
- See Also:
-
DEFAULT_SPOUT_NUM
public static final int DEFAULT_SPOUT_NUM- See Also:
-
DEFAULT_BOLT_NUM
public static final int DEFAULT_BOLT_NUM- See Also:
-
DEFAULT_HDFS_BATCH
public static final int DEFAULT_HDFS_BATCH- See Also:
-
TOPOLOGY_NAME
- See Also:
-
SPOUT_ID
- See Also:
-
BOLT_ID
- See Also:
-
-
Constructor Details
-
KafkaClientHdfsTopo
public KafkaClientHdfsTopo()
-
-
Method Details
-
getInt
-
getStr
-
main
Copies text file content from sourceDir to destinationDir. Moves source files into sourceDir after its done consuming.- Throws:
Exception
-