AWS, DevOps

Docker Logging Methods that Fit your Deployment Strategy

With the huge success of micro-services and container technologies, most of the enterprises are migrating their architecture to the container-based solution which is more reliable and flexible as compared to monolithic architecture. Moving to containerized solution like Docker, logging each container and its insights is a new...

by Mayur Rastogi
Tag: ELK
24-Feb-2017

DevOps, Technology

Running Curator in Docker container to remove old Elasticsearch indexes

We have been using ELK as a centralized logs management system. ELK stands for Elasticsearch, Logstash, and Kibana. Each of the three services is running inside its own docker container in one docker-network (say elk-net) on a single server. A separate block storage device is mapped from the host into Elasticsearch container (named es)...

by Navjot Singh
Tag: ELK
30-May-2016

AWS, DevOps

Tweaking Logstash’s S3 plugin to create folders in YYYY/MM/DD format on AWS S3

Logstash is a service that accepts logs from a variety of systems, processes it and allows us to index it in Elasticsearch etc which can be visualised using Kibana. Our DevOps engineers have been using Logstash S3 plugin which simply puts all data in a S3 bucket location. Since we have configured files to be created in every hour on...

by Navjot Singh
Tag: ELK
25-May-2016