Apache Flume 1.6.0 Installation on Ubuntu 14.04
Apache Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data. It has a simple and flexible architecture based on streaming data flows. It is robust and fault tolerant with tunable reliability mechanisms and many failover and recovery mechanisms. It uses a simple extensible data model that allows for online analytic application.
1) A machine with Ubuntu 14.04 LTS operating system.
2) Apache Hadoop pre installed (How to install Hadoop on Ubuntu 14.04)
3) Apache Flume 1.6.0 software (Download Here)
Apache Flume Installation on ubuntu
Step 1 - Update. Open a terminal (CTRL + ALT + T) and type the following sudo command. It is advisable to run this before installing any package, and necessary to run it to install the latest updates, even if you have not added or removed any Software Sources.
Step 2 - Installing Java 7.
Step 3 - Creating flume directory.
Step 4 - Change the ownership and permissions of the directory /usr/local/flume. Here 'hduser' is an Ubuntu username.
Step 5 - Change the directory to /home/hduser/Desktop , In my case the downloaded apache-flume-1.6.0-bin.tar.gz file is in /home/hduser/Desktop folder. For you it might be in /downloads folder check it.
Step 6 - Untar the apache-flume-1.6.0-bin.tar.gz file.
Step 7 - Move the contents of apache-flume-1.6.0-bin folder to /usr/local/flume
Step 8 - Edit $HOME/.bashrc file by adding the flume path.
$HOME/.bashrc file. Add the following lines
Step 9 - Reload your changed $HOME/.bashrc settings
Step 10 - Change the directory to /usr/local/flume/conf
Step 11 - Copy the default flume-env.sh.template to flume-env.sh
Step 12 - Edit flume-env.sh file.
Step 13 - Add java path to flume-env.sh file. Save and Close.
Step 14 - Copy the default flume-conf.properties.template to flume-conf.properties
Step 15 - Change the directory to /usr/local/flume/bin
Step 16 - Verify Installation
Please share this blog post and follow me for latest updates on
Previous Post Next Post