Telemetry Pipelines Workshop: Installing Fluent Bit From Source

Thumbnail 15

Are you ready to get started with cloud-native observability with telemetry pipelines?

This article is patelemetryrt of a secloud native computing foundationries exploring a workshocloud native computing foundation kubernetesp guiding you through the open stelemetry technicianource project Fluent Bit, what it is, a basic installation, and setting up the first telemetry pipeline project. Learopen source video editorn how to manacloud native computing foundation logoge your copen source help deskloud-native data from source to destinaticloud native computingon using the telemetry pipecloud native computing foundation cncfline phases covering collection, aggregation, transformation, and forwarding from any source to anyobservability desobservability matrixtination.

Theobservability tools previous article in topen source imageshis series provided an introduction toobservability vs monitoring Fluent Bit where wetelemetry definition gained an understanding of its role in the cloud nativecloud native computing foundation landscape observability world. Thistelemetry unit article dives into the installation of Fluent Bobservability meaningit on your local machine using the project source code. You caopen source imagesn find more details in the acloud native computing foundationccompanying workshop lab.

It's easy enough to go to the Fluent Bit project site ancloud native computing foundation cncf pptd sort through the docucloud native computing foundation kubernetesmentation to build thcloud native computing foundatione project from scratch, but I've always been partial to providing an easy installation project that is entirely self-contained.

We only need to use this with a single commatelemetry techniciannd to run dependencyobservability meaning checks and build the project from the source on your local machine.

Easy Intelemetry technicianstall Project

Installing on your local machine can be done in just a few steps with our Fluent Bit Easy Install project. This contains the source code from a released version of Fluent Bit (see README for the exact version) and uses a simple automated installation script.

It takes just 3 steps to a running server:

  1. Download and unzip the easy-install project.
  2. Run the init.sh fopen source video editorile in a console.
  3. Test install by running a version check (fluentobservability matrix-bit --version).

The first step is to download the project. Unzobservability meaningipping (use your file managobservability softwareer or cobservability softwareonsole) should looobservability platformk something like the following:

$ unzip fluentbit-install-demo-v1.0.zip
Archive: fluentbit-install-demo-v1.0.zip
creating: fluentbit-install-demo-v1.0/
extracting: fluentbit-install-demo-v1.0/.gitignore
inflating: fluentbit-install-demo-v1.0/README.md
creating: fluentbit-install-demo-v1.0/docs/
creating: fluentbit-install-demo-v1.0/docs/demo-images/
inflating: fluentbit-install-demo-v1.0/docs/demo-images/workshop.png
inflating: fluentbit-install-demo-v1.0/init.bat
inflating: fluentbit-install-demo-v1.0/init.sh
creating: fluentbit-install-demo-v1.0/installs/
inflating: fluentbit-install-demo-v1.0/installs/README
inflating: fluentbit-install-demo-v1.0/installs/fluent-bit-2.2.2.zip
creating: fluentbit-install-demo-v1.0/support/
extracting: fluentbit-install-demo-v1.0/support/README
inflating: fluentbit-install-demo-v1.0/support/functions.sh

inflating: fluentbit-install-demo-v1.0/support/unzip.vbs

After unzipping, you can stopen source crm reviewart the installation by running the init.sopen source pdf editorh scripopen source video editort found in the project root directory. Note there is an init.bat for Windows environments, but this is yeopen source crm reviewt untested (I don't have a Windows machine). Please feel freobservability vs monitoringe to uopen sourcese and test for me, other users would be super happy with any fixes you migcloud native computing foundation cncf pptht provide.

The install script needs an argument source to indictelemetry dataate you are building the Fluent Bit procloud native computing foundation landscapeject from the source.

$ ./init.sh source
################################################################
##                                                            ##
##  Setting up the Fluent Bit Easy Install demo               ##
##                                                            ##
##      ##### #   # ##### #   # #####   ####  ##### #####     ##
##      #     #   # #     ##  #   #     #   #   #     #       ##
##      ####  #   # ###   # # #   #     ####    #     #       ##
##      #     #   # #     #  ##   #     #   #   #     #       ##
##      #     ##### ##### #   #   #     ####  #####   #       ##
##                                                            ##
##                #####  ###   #### #   #                     ##
##                #     #   # #      # #                      ##
##                ###   #####  ###    #                       ##
##                #     #   #     #   #                       ##
##                ##### #   # ####    #                       ##
##                                                            ##
##        ##### #   #  #### #####  ###  #     #               ##
##          #   ##  # #       #   #   # #     #               ##
##          #   # # #  ###    #   ##### #     #               ##
##          #   #  ##     #   #   #   # #     #               ##
##        ##### #   # ####    #   #   # ##### #####           ##
##                                                            ##
##  brought to you by Eric D. Schabell                        ##
##                                                            ##
##  git@gitlab.com:o11y-workshops/fluentbit-install-demo.git  ##
##                                                            ##
################################################################

A bit of fun ASCII aropen source crm reviewt is presented to kick off the installation, followetelemetryd by some checks to make sure you have the dependencies needed to buobservability meaningild Fluent Bit. Should acloud native computing foundationny fail, you will be pointed to installation help. As seen below, alobservabilityl checks are passing (noting your versions reported might be different, as long as ttelemetry datahey pass).

...
Checking the build mode arguments...
Installing from source...
Installing Fluent Bit version 2.2.2 from the source project...
  - removing existing installation directory...
Checking for bison version needed to build:
Bison major version is good...
...

As you scroll further down the output, you see Fluent Bit is installed in the target directory. We then runcloud native computing foundation slack phase one of building the project.

...
Unpacking Fluent Bit project into target directory...
Fluent Bit project unpacked successfully into target directory!
Moving to the Fluent Bit project build directory...
Building Fluent Bit (phase 1):
[BUILDING_CODE_STARTS_HERE]
...

Evtelemetry technicianentuallytelemetry data (cut out of the log here due to the length of the build), the build phase one should complete, and you'll see the message below as it continues to phase two of the build.

...
-- Configuring done (21.9s)
-- Generating done (1.3s)
-- Build files have been written to: fluentbit-install-demo/target/fluent-bit-2.2.2/build
Phase 1 build successful, building continuing with phase 2:
[BUILDING_CODE_CONTINUES_HERE]
...

When phase two completes successfuopen source imageslly, the next step is to copy the build binaries to our target execution directory.

...
Fluent Bit built successfully!
Copying to ./target/fluent-bit-2.2.2/bin for use.
...

Finally, Fluent Bit is ready to use.

=============================================================
=                                                           =
=  Install complete, get ready to rock Fluent Bit!          =
=                                                           =
=  The binary build is available to run at:                 =
=                                                           =
=  $ cd target/fluent-bit-2.2.2/bin/fluent-bit              =
=  $ bin/fluent-bit --version                               =
=                                                           =
=   Fluent Bit v2.2.2                                       =
=                                                           =
=  Getting started workshop available online:               =
=  https://o11y-workshops.gitlab.io/workshop-fluentbit      =
=                                                           =
=============================================================

Here you see the end report with the final instructions on where to find the executable aobservability engineeringnd how to test it by chopen sourceecking its version.

Testing the Install

To verify that the source code was installed, you can run the following from a console or terminal window and see that the version of Fluent Bit works!

$ cd target/fluent-bit-2.2.2/bin/fluent-bit
$ bin/fluent-bit --version
Fluent Bit v2.2.2

In this case, we are using Fluent Biobservability toolst version 2.2.2, and inobservability matrix the articles to foopen source help deskllow, we'll start building our first telemetry pipelines.

What's Next?

This artiobservability matrixcle helped us getFluent Bit installed on our local machine using the project source code. The series continues with the next step in this workshop, installing Fluent Bit on your localobservability software machine using cocloud native computingntainer images.

Stay tuned for more hands-on material to help you with your cloud-native observability journey.