Introduction and Installation of Logstash

So far in this series on ELK (Elasticsearch-Logstash-Kibana) stack, we have talked about Elasticsearch and Kibana(here and here). It’s about time we look at the third pillar of this stack – Logstash. So, what is Logstash? Logstash is an open source data collection engine with real-time pipelining capabilities.  This implies that Logstash can dynamically put... » read more

Introduction to Visualizations using Kibana with Elasticsearch

We talked about Kibana installation on Ubuntu in the previous blog post, let’s look at how to setup some basic visualizations using Kibana with Elasticsearch. Log into Kibana using Once the Kibana page opens up, from the left side Menu, click on “Management” and then choose Index Patterns->create Index Pattern and fill in the... » read more

Kibana Installation and Troubleshooting Tips

In the previous blog post, we gave a bird’s eye introduction to Elasticsearch, which is a highly scalable open-source full-text search and analytics engine.  But, everyone does not get a kick out of typing commands for querying data using Elasticsearch. Is there another way around? What is Kibana? Why is it required when I already... » read more

Beginners Guide to Elasticsearch

What is Elasticsearch and why should I know about it? Elasticsearch is a highly scalable open-source full-text search and analytics engine. It allows you to store, search and analyze big volumes of data quickly and in near real time (Numbers, text, geo, structured, unstructured. All data types are welcome). It is generally used as the... » read more

Linear regression using Apache Spark MLlib

What is linear Regression? Wikipedia states – In statistics, linear regression is a linear approach to modeling the relationship between  dependent variable and one or more  independent variables. Linear regression is a basic and commonly used type of predictive analysis. Back to school math, every straight line can be represented by the equation: y = mx + b, where y is dependent variable... » read more

Introduction to Filebeat

What is Filebeat? Official documentation states that “Filebeat is a lightweight shipper for forwarding and centralizing log data. Installed as an agent on your servers, Filebeat monitors the log files or locations that you specify, collects log events and forwards them to either Elasticsearch or Logstash for indexing. When you kickoff Filebeat, it starts one or more inputs... » read more