Channel

memory?

內存中，快，非持久事件傳輸

MemoryChannel

Channel

file

一個 reading, writing, mapping, 和 manipulating 一個文件 的 channel

FileChannel

Channel

jdbc

JDBC-based, durable event transport (Derby-based)

JDBCChannel

Channel

recoverablememory

一個用本地文件系統做存儲的非持久 channel 實現

RecoverableMemoryChannel

Channel

org.apache.flume.channel.PseudoTxnMemoryChannel

主要用作測試，不是生產用的

PseudoTxnMemoryChannel

Channel

(custom type as FQCN)

你自己的 Channel 實現

(custom FQCN)

Source

avro

Avro Netty RPC event source

AvroSource

Source

exec

Execute a long-lived Unix process and read from stdout

ExecSource

Source

netcat

Netcat style TCP event source

NetcatSource

Source

seq

Monotonically incrementing sequence generator event source

SequenceGeneratorSource

Source

org.apache.flume.source.StressSource

主要用作測試，不是生產用的。Serves as a continuous source of events where each event has the same payload. The payload consists of some number of bytes (specified by?size?property, defaults to 500) where each byte has the signed value Byte.MAX_VALUE (0x7F, or 127).?

org.apache.flume.source.StressSource

Source?

syslogtcp?

?

SyslogTcpSource?

Source

syslogudp

?

SyslogUDPSource

Source

org.apache.flume.source.avroLegacy.AvroLegacySource

?

AvroLegacySource?

Source

org.apache.flume.source.thriftLegacy.ThriftLegacySource

?

ThriftLegacySource?

Source

org.apache.flume.source.scribe.ScribeSource

?

ScribeSource?

Source?

(custom type as FQCN)?

你自己的 Source 實現

(custom FQCN)?

Sink

hdfs

Writes all events received to HDFS (with support for rolling, bucketing, HDFS-200 append, and more)

HDFSEventSink

Sink?

org.apache.flume.sink.hbase.HBaseSink

A simple sink that reads events from a channel and writes them to HBase.

org.apache.flume.sink.hbase.HBaseSink

Sink?

org.apache.flume.sink.hbase.AsyncHBaseSink

?

org.apache.flume.sink.hbase.AsyncHBaseSink

Sink

logger

Log events at INFO level via configured logging subsystem (log4j by default)

LoggerSink

Sink

avro

Sink that invokes a pre-defined Avro protocol method for all events it receives (when paired with an avro source, forms tiered collection)

AvroSink

Sink?

file_roll?

?

RollingFileSink?

Sink?

irc?

?

IRCSink?

Sink

null?

/dev/null for Flume - blackhole all events received

NullSink

Sink?

(custom type as FQCN)?

你自己的?Sink 實現

(custom FQCN)?

ChannelSelector?

replicating?

?

ReplicatingChannelSelector

ChannelSelector?

multiplexing?

?

MultiplexingChannelSelector

ChannelSelector?

(custom type)?

你自己的 ChannelSelector 實現

(custom FQCN)?

SinkProcessor?

default?

?

DefaultSinkProcessor

SinkProcessor?

failover?

?

FailoverSinkProcessor

SinkProcessor?

load_balance?

多sink時提供平衡加載的能力

LoadBalancingSinkProcessor

SinkProcessor?

(custom type as FQCN)?

你自己的?SinkProcessor 實現

(custom FQCN)?

Interceptor$Builder

host

?

HostInterceptor$Builder

Interceptor$Builder

timestamp

TimestampInterceptor

TimestampInterceptor$Builder

Interceptor$Builder

static?

?

StaticInterceptor$Builder

Interceptor$Builder

regex_filter?

?

RegexFilteringInterceptor$Builder

Interceptor$Builder

(custom type as FQCN)

你自己的?Interceptor$Builder 實現

(custom FQCN)

EventSerializer$Builder?

text?

?

BodyTextEventSerializer$Builder?

EventSerializer$Builder

avro_event?

?

FlumeEventAvroEventSerializer$Builder?

EventSerializer

org.apache.flume.sink.hbase.SimpleHbaseEventSerializer

?

SimpleHbaseEventSerializer

EventSerializer

org.apache.flume.sink.hbase.SimpleAsyncHbaseEventSerializer

?

SimpleAsyncHbaseEventSerializer

EventSerializer

org.apache.flume.sink.hbase.RegexHbaseEventSerializer

?

RegexHbaseEventSerializer

HbaseEventSerializer

Custom implementation of serializer for HBaseSink.?
(custom type as FQCN)

你自己的 HbaseEventSerializer 實現

(custom FQCN)

AsyncHbaseEventSerializer

Custom implementation of serializer for AsyncHbase sink.?
(custom type as FQCN)

你自己的?AsyncHbaseEventSerializer 實現

(custom FQCN)

EventSerializer$Builder

Custom implementation of serializer for all sinks except for HBaseSink and AsyncHBaseSink.?
(custom type as FQCN)

你自己的?EventSerializer$Builder 實現

(custom FQCN)

--conf,-c <conf>

在 <conf> 文件夾使用配置

--classpath,-C <cp>

追加到 classpath

--dryrun,-d?

不真正啟動 Flume,僅僅打印命令

-Dproperty=value?

設置一個JDK 系統的合適值

--conf-file,-f <file>

聲明你要執行哪一個配置文件 (必須)

--name,-n <agentname>

聲明我們要執行的 agent 的名字(必須)

--host,-H <hostname>

指定 Flume agent 的主機名 (可能是本機)

--port,-p <port>

指定 Avro source 監聽的port號

--filename,-F <filename>

發送 <filename> 的每一行給 Flume (可選)

--headerFile,-F <file>

頭文件的每一行包括 鍵/值對