AWS, DevOps

Elasticsearch Plugins for Monitoring and Management of Cluster Nodes

Elasticsearch offers highly useful plugin mechanism as a standard way for extending its core functionality such as custom analyzer, native scripts and more. While some plugins may contain static content which is served through its HTTP server, some others offer a graphical front-end for selected parts of the Elasticsearch REST API such...

by Neha Dixit
Tag: elasticsearch
27-Feb-2017

AWS, DevOps

Elasticsearch Cluster with AWS Spot Instances

One of the most challenging tasks in any microservices ecosystem is the centralized log management, and there are many open source and paid solutions available in the market. In our ecosystem, we are using ELK stack as it provides scalability and the multitenant-capable full-text search engine that easily integrates with Logstash and...

by Neeraj Gupta
Tag: elasticsearch
11-Nov-2016

Technology

Collecting Tomcat logs using Fluentd and Elasticsearch

In our previous blog, we have covered the basics of fluentd, the lifecycle of fluentd events and the primary directives involved. In this blog, we'll configure fluentd to dump tomcat logs to Elasticsearch. We'll also talk about filter directive/plugin and how to configure it to add hostname field in the event stream. Fluentd...

by Arun Dhyani
Tag: elasticsearch
05-Oct-2016

Technology

Backing Up ElasticSearch

As with any software that stores data it is important o take back up of that data. Elastic search is a data store with exceptionally good capabilities of searching. In elastic search data is stored in indexes. So Either you can take back up of whole cluster or you can take back up of indexes you want. Elastic search provides a great...

by Satya Kanodia
Tag: elasticsearch
29-Jul-2016

AWS, Database

Elasticsearch: Shard Filterting

Our cloud DevOps engineers have been using Elasticsearch on production environment for an e-commerce website for quite a while. The website has one admin server to manage activities such as adding new production, managing discounts on various items, fetching reports etc. We came across a requirement where downloading reports from admin...

by Navjot Singh
Tag: elasticsearch
25-May-2016

AWS, DevOps

Elasticsearch Migration : Found to AWS EC2

Our DevOps team was using Found for one of our projects in the production environment. We have been facing a problem with found where it’s memory pressure frequently goes up and does not drop down so easily and until the time it remains up the Found was not able to serve the requests. Then, we decided to move to self-hosted...

by Navjot Singh
Tag: elasticsearch
04-May-2016

Technology

Build Custom Analyzer in Elasticsearch

In our project we have two use cases where, we need a custom analyzer that answers both the below use cases :- Let's take a string "king of pop michael jackson" thats indexed somewhere in my elasticsearch document. 1. First Use Case :- Searching Substring : Sometimes the end user doesn't want to write the complete word for...

by Ashu Kohli
Tag: elasticsearch
19-May-2015

Big Data, CQ5/AEM

Integrating ElasticSearch with AEM

In adaptTo() 2014, I delivered a talk on "Integrating ElasticSearch with AEM". It started with a brief introduction about ElasticSearch, its working and flexibilty when it comes to huge amount of data. Here is a brief review of topics covered after that: How data is analyzed and indexed on the server Integration approaches with AEM...

by Vivek Sachdeva
Tag: elasticsearch
25-Sep-2014