Package org.apache.storm.hdfs.bolt
Class SequenceFileBolt
java.lang.Object
org.apache.storm.topology.base.BaseComponent
org.apache.storm.topology.base.BaseRichBolt
org.apache.storm.hdfs.bolt.AbstractHdfsBolt
org.apache.storm.hdfs.bolt.SequenceFileBolt
- All Implemented Interfaces:
Serializable
,IBolt
,IComponent
,IRichBolt
- See Also:
-
Field Summary
Fields inherited from class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
collector, configKey, fileNameFormat, fileRetryCount, fs, fsUrl, hdfsConfig, maxOpenFiles, offset, partitioner, rotationActions, rotationCounterMap, rotationPolicy, rotationTimer, syncPolicy, tickTupleInterval, writeLock, writers
-
Constructor Summary
-
Method Summary
Modifier and TypeMethodDescriptionaddRotationAction
(RotationAction action) void
doPrepare
(Map<String, Object> conf, TopologyContext topologyContext, OutputCollector collector) protected String
getWriterKey
(Tuple tuple) protected AbstractHDFSWriter
makeNewWriter
(org.apache.hadoop.fs.Path path, Tuple tuple) withCompressionCodec
(String codec) withCompressionType
(org.apache.hadoop.io.SequenceFile.CompressionType compressionType) withConfigKey
(String configKey) withFileNameFormat
(FileNameFormat fileNameFormat) withMaxOpenFiles
(int maxOpenFiles) withPartitioner
(Partitioner partitioner) withRetryCount
(int fileRetryCount) withRotationPolicy
(FileRotationPolicy rotationPolicy) withSequenceFormat
(SequenceFormat format) withSyncPolicy
(SyncPolicy syncPolicy) withTickTupleIntervalSeconds
(int interval) Methods inherited from class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
cleanup, declareOutputFields, execute, getBasePathForNextFile, getComponentConfiguration, prepare, rotateOutputFile
-
Constructor Details
-
SequenceFileBolt
public SequenceFileBolt()
-
-
Method Details
-
withCompressionCodec
-
withFsUrl
-
withConfigKey
-
withFileNameFormat
-
withSequenceFormat
-
withSyncPolicy
-
withRotationPolicy
-
withCompressionType
public SequenceFileBolt withCompressionType(org.apache.hadoop.io.SequenceFile.CompressionType compressionType) -
withTickTupleIntervalSeconds
-
addRotationAction
-
withRetryCount
-
withPartitioner
-
withMaxOpenFiles
-
doPrepare
public void doPrepare(Map<String, Object> conf, TopologyContext topologyContext, OutputCollector collector) throws IOException- Specified by:
doPrepare
in classAbstractHdfsBolt
- Throws:
IOException
-
getWriterKey
- Specified by:
getWriterKey
in classAbstractHdfsBolt
-
makeNewWriter
protected AbstractHDFSWriter makeNewWriter(org.apache.hadoop.fs.Path path, Tuple tuple) throws IOException - Specified by:
makeNewWriter
in classAbstractHdfsBolt
- Throws:
IOException
-