Data Collection

Installing Fluentd Using Ruby Gem

This article explains how to install Fluentd using Ruby gem.

Before Installation

Please follow the Preinstallation Guide to configure your OS properly. This will prevent many unnecessary problems.

Install Ruby interpreter

Please install Ruby >= 1.9.3 on your local environment.

Install Fluentd gem

Fetch and install the fluentd Ruby gem using the gem command. The official ruby gem page is here.

$ gem install fluentd --no-ri --no-rdoc

Run

Run the following commands to confirm that Fluentd was installed successfully:

$ fluentd --setup ./fluent
$ fluentd -c ./fluent/fluent.conf -vv &
$ echo '{"json":"message"}' | fluent-cat debug.test

The last command sends Fluentd a message ‘{“json”:”message”}’ with a “debug.test” tag. If the installation was successful, Fluentd will output the following message:

2011-07-10 16:49:50 +0900 debug.test: {"json":"message"}

NOTE: It's HIGHLY recommended that you set up ntpd on the node to prevent invalid timestamps in your logs.

NOTE: For large deployments, you must use jemalloc to avoid memory fragmentation. This is already included in the rpm and deb packages.

NOTE: The Fluentd gem doesn't come with /etc/init.d/ scripts. You should use process management tools such as daemontools, runit, supervisord, or upstart.