Navjot Singh

DevOps, Technology

Integrating SonarQube with Jenkins

Recently, we got a requirement where Grails Development team needs to have a one-click interface to run units test cases for their Grails application and send the results to SonarQube. SonarQube is a web-based application which is used for centralized management of code quality. We decided to integrate it with Jenkins to provide...


AWS, DevOps

8 Things to consider while Migrating Cloud Infrastructure between AWS Regions

With the recent launch of AWS’s Mumbai region, the first thought that comes to the mind of any DevOps would be to migrate IT-Infra from Singapore region to Mumbai if we have a huge customer base in India. This would, of course, decrease the latency as well as help them to save a lot of bucks as it is cheaper than Singapore region. ...


AWS, DevOps

Automate Selenium testing with Jenkins

Selenium is a tool widely used for automating testing of web applications. One step ahead, integrating the selenium with Jenkins takes it to the next level. In this blog, we would be configuring Jenkins to run selenium test cases on an ubuntu environment. Scenario: Configure Jenkins to perform Selenium test cases with one click. ...


AWS, DevOps

Access and Modify Google Sheet using Python

  This would be my first blog where I am using Python. I am excited to share what I did using Python. I wanted to update google sheet using bash shell scripting but did not found anything I can play around using bash. Later, I opted for Python as it provides "gspread" library which could be used to work on google sheet. ...


DevOps, Technology

Running Curator in Docker container to remove old Elasticsearch indexes

We have been using ELK as a centralized logs management system. ELK stands for Elasticsearch, Logstash, and Kibana. Each of the three services is running inside its own docker container in one docker-network (say elk-net) on a single server. A separate block storage device is mapped from the host into Elasticsearch container (named es)...


AWS, DevOps

Tweaking Logstash’s S3 plugin to create folders in YYYY/MM/DD format on AWS S3

Logstash is a service that accepts logs from a variety of systems, processes it and allows us to index it in Elasticsearch etc which can be visualised using Kibana. Our DevOps engineers have been using Logstash S3 plugin which simply puts all data in a S3 bucket location. Since we have configured files to be created in every hour on...


AWS, DevOps

Elasticsearch: Shard Filterting

Our cloud DevOps engineers have been using Elasticsearch on production environment for an e-commerce website for quite a while. The website has one admin server to manage activities such as adding new production, managing discounts on various items, fetching reports etc. We came across a requirement where downloading reports from admin...


AWS, DevOps

Elasticsearch Migration : Found to AWS EC2

Our DevOps team was using Found for one of our projects in the production environment. We have been facing a problem with found where it’s memory pressure frequently goes up and does not drop down so easily and until the time it remains up the Found was not able to serve the requests. Then, we decided to move to self-hosted...


AWS, DevOps

Set up Docker Registry Proxy Cache Server

With the large scale adoption of the Docker by the developers, it becomes necessary to provide a proxy cache server for Docker registry where Docker image once downloaded from Docker Hub can be retrieved again from the local proxy server. This saves us a lot of time from downloading the image again and again from Docker Hub.Scenario:Set...



Cross-domain SSO with Google into AWS Console using SAML

Recently, I worked on a task wherein the users had to be authenticated based on existing Google credentials to get access of AWS Management Console. It took more time than expected to make it work as the documentation provided by Google is not complete. Let’s start by setting this up step by step. Scenario: Provide access of AWS...



MongoDB Replica set using Docker Networking and Docker Compose

Recently, I got a chance to dockerize a traditional MongoDB replica set. Currently, I am doing it for QA and UAT environment where MongoDB replica set is setup on a single host. So, in this blog, we will do it on a single host using Docker Networking and Docker Compose. Scenario: Set up a MongoDB replica using version 3.0.5 set...


AWS, DevOps

Automated Docker Deployment using Jenkins

Building a Docker image from a Dockerfile, creating a latest tag and pushing it on DockerHub are equivalent to executing three different commands manually. This could be automated by creating a bash script. Well, that was not a big deal until I had a requirement where I needed to perform above actions and additional task of immediately...