Logit.io is a log management and analysis platform that allows you to centralise and analyse your logs and metrics from various sources such as applications, servers, and cloud platforms. Our platform provides real-time log analysis, powerful search capabilities, custom dashboards, and alerts for issues and anomalies.
Setting up, configuring and sending logs and metrics to Logstash can appear to be a complicated process, this guide aims to show you that by using Logit it is actually a simple process.
In this guide, you can find out how to:
Creating your free trial
If you don’t yet have a Logit.io account, sign up on the Logit.io homepage and create an account to start your 14 day free trial.
Tip! Your free trial is fully featured with no maximum daily volume or data retention limits, allowing you to send as much data as you need.
It’s simple to create an account, choose your preferred authentication method or enter your business email address and password, then select ‘Get Free Trial’
Signing up for a new trial account, presents you with two options. If you’re familiar with using an observability platform then choose ‘Explore Logit.io’ to move to your dashboard, for a step by step guide to getting started select ‘Guide Me.’
If you have signed up to join an existing company account, then select the joining an existing account link at the bottom of the screen, you can also resend the invite email if required.
Selecting ‘Guide Me’ presents you with the configure stack screen. From here you can configure your first stack, including region, account name and stack name. This information can be amended later if needed.
Each fully managed stack can include services for Log Management, Infrastructure Metrics and Tracing / Application Performance Monitoring. For the purpose of getting started shipping sample data, add ‘Log Management.’
Sending Sample Data to your Logit.io Stack
Step 2 gives you the opportunity to send Sample data into your Logit.io stack, If you’re not ready to configure and ship your own data just yet choose the ‘Add Sample Data’ button.
A new tab will open in your browser from where you can choose from three sample data sets. Select 'Add data' for your preferred sample data sets, once installed, select ‘View Data.’ this will open the predefined dashboard for your sample log data.
From here, you have powerful search and filtering options that allow you to quickly analyse your data. You can choose from the date selector to drill down as required.
To look at the raw log data, choose 'Discover' in the left hand menu. Your data can be stored in different indexes, to view the sample log data, choose the sample data index pattern.
5. You can see the timeline across the top of the screen, the stack is receiving the sample log data, so you can now filter making it easier and faster to find what you need. You can do this by dragging the cursor across the timeline at the top of the screen to drill down into a specific time period.
6. You can also expand each individual log so you can look deeper into the raw data.
7. You can make the view more useful and manageable by selecting just the fields of data you want to see in the main view using the icons on the left.
Shipping system logs to your stack using Metricbeat
Return to the main dashboard to continue onboarding, select ‘Next Step’ for step 3 to configure data sources for your logs, metrics and traces.
Select ‘Send Logs’ to start shipping logs to your Logit.io stack. This will open a new tab showing integration guides for all data sources.
Select 'Metricbeat' from the filtered list. Metricbeat is a good tool for quickly getting started sending log data to your stack from your machine.
Each data source integration provides you with step-by-step instructions to make it easy to start shipping data. For this guide we will configure Metricbeat on a local MacOS device. Select 'Install Metricbeat'
Copy the relevant curl command depending on your system and paste it in your terminal, this will download the lightweight Metricbeat shipper to your destination folder.
curl -L -O https://artifacts.elastic.co/downloads/beats/metricbeat/metricbeat-8.6.2-darwin-x86_64.tar.gz
tar xzvf metricbeat-8.6.2-darwin-x86_64.tar.gzTo proceed with the Metricbeat integration, after the download completes, follow step two in the integration guide, which involves overwriting the yml configuration file with the pre-configured Metricbeat configuration file provided.
############# Logit.io Metricbeat Configuration ################## ================== Modules configuration =====================
metricbeat.config.modules:
# Glob pattern for configuration loading
path: ${path.config}/modules.d/*.yml
# Set to true to enable config reloading
reload.enabled: false
# Period on which files under path should be checked for changes
#reload.period: 10s
# ======================= Elasticsearch template setting =======================
setup.template.settings:
index.number_of_shards: 1
index.codec: best_compression
#_source.enabled: false
# ================================== Outputs ===================================
# ------------------------------ Logstash Output -------------------------------
output.logstash:
hosts: ["your-logstash-host:your-beats-ssl-port"]
loadbalance: true
ssl.enabled: true
# ================================= Processors =================================
processors:
- add_host_metadata: ~
- add_cloud_metadata: ~
- add_docker_metadata: ~
- add_kubernetes_metadata: ~Open the extracted Metricbeat folder and edit the metricbeat.yml file. Replace the file contents with the copied configuration file, which sets your host to point at your Logit.io stack. Save and close the file.
Continue to step 3 of the source guide to validate the Metricbeat configuration file changes. Copy and run the macOS command, if the file is invalid you will see “error loading config file” and details of how to correct any issues.
sudo ./metricbeat -e -c metricbeat.yml
If you see any permissions related issues proceed to step 4 and ensure the correct ownership of the yml files. If the configuration is correct you should see a successful connection to your Logit.io stack in the terminal. Then, proceed to the next step of the onboarding.In step 4, we may need to change the ownership of our configuration files and then we can proceed and start Metricbeat. Copy and run the chown commands as shown.
sudo chown root metricbeat.yml
sudo chown root modules.d/system.ymlsudo ./metricbeat -e
If the configuration is correct you should see a successful connection to your Logit.io stack in the terminal as shown below.
11. We can then return to the next step in the onboarding process, return to the other browser tab to continue the guide.
12. Continue to Step 5 of the onboarding process, you can invite teammates to the same account if needed (you can also do this later too) then choose ‘Go to my Dashboard’.
13. Select ‘Launch Logs’ to return you to the Discover view on your dashboard. Success! You should now see Metricbeat data flowing into your Logit.io stack.
Adding a dashboard to your trial Logit stack
Choose ‘Guide me’ in the left hand menu or at the top of your screen, and go to Step 4 ‘Choose Dashboards’
Select ‘System’ under ‘Metrics Management Dashboards’ for predefined dashboards to visualise system metrics from the Metricbeat shipper we've just configured.
Now return to the Logit.io dashboard and choose ‘Launch logs’.
You can view the dashboards you just loaded in the stack from the left menu. You will see you have a number of Metricbeat dashboards now available to you. I’m going to open the one called [Metricbeat System] Overview ECS
In minutes, Logit.io lets you send, filter, analyse and quickly derive value from your data.
What Next?
Getting started shipping logs using Filebeat