logstash 1.1.x transport performance

	A	B	C	D	E	F	G	H	I	J	K
1	publisher	transport	consumer	publish rate	consume rate	flow controls?	securable?	compressed?	lossless?	notes

2	logstash	N/A	N/A	33500		N/A	N/A	N/A	N/A	CONTROL CASE	CONTROL CASE
3	yes \| netcat	tcp	logstash		32000	yes	☹	☹	☹	CONTROL CASE	CONTROL CASE
4	yes \|	stdin	logstash		31000	yes	☹	☹	☹	CONTROL CASE	CONTROL CASE
5
6	lumberjack	lumberjack	logstash	25000*	25000	yes	yes	yes	yes	delicious, but I'd still like to see higher throughput.
7	logstash	zmq pushpull	logstash	22000	15000	disabled	☹	☹	☹
8	logstash	zmq pushpull	logstash	15800	15800	hwm=50	☹	☹	☹
9	logstash	lumberjack	logstash	8000	8000	yes	yes	yes	yes	not as fast as lumberjack->logstash direct!
10	logstash	redis	logstash	7500	5900	possible	☹	☹	possible	can implement flow control in the publisher
11	logstash	redis >batch=true	logstash	22000	6000	possible	☹	☹	possible	can implement flow control in the publisher
12	logstash	redis >batch=true < batch_count=50	logstash	24000	13000	possible	☹	☹	possible
13	logstash	redis >batch=true < batch_count=50 < threads=2	logstash	23500	23500	possible	☹	☹	possible
14	logstash	rabbitmq	logstash	6000	3000	not possible	yes	☹	yes	☹☹☹ slowest; cannot implement flow control.
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100