AWS, DevOps

Tweaking Logstash’s S3 plugin to create folders in YYYY/MM/DD format on AWS S3

Logstash is a service that accepts logs from a variety of systems, processes it and allows us to index it in Elasticsearch etc which can be visualised using Kibana. Our DevOps engineers have been using Logstash S3 plugin which simply puts all data in a S3 bucket location. Since we have configured files to be created in every hour on...

by Navjot Singh
Tag: directory hirerachy
25-May-2016