Anaytics, Big Data, Cloud

Improving query performance in Snowflake and its related costs

In the previous blog we understood how to Optimally use Snowflake Warehouse and Tables. So let’s continue the blog series, where we will now focus on improving the performance in Snowflake and its associated costs. As we know, Snowflake tables are micro-partitioned, which significantly improves query performance. However, over time, you may experience slowness in […]

May 15, 2023

Cloud, DevOps

Penny Pincher – Cloud Resource Optimization recommendation based on historical data to save cost.

With growing businesses in Amazon Web Services (AWS), finding idle resources, auditing your costs and managing your inventory are some of the most complex use-cases. This is particularly true for businesses or organizations that utilize a wide range of AWS services and resources, as keeping track of all these or idle resources can quickly become […]

May 9, 2023

Anaytics, Big Data, Cloud

Optimal use from Snowflake Warehouse and Tables

In the previous blog, we discussed the Best practices to be followed while Data loading into Snowflake from Stages. Continuing the snowflake blog series lets us understand how to use Snowflake Warehouse and Tables optimally. Snowflakes Virtual Warehouses Virtual Warehouses is one of the critical components in Snowflake architecture and deciding the correct configurations for […]

March 30, 2023

Cloud, DevOps

How to access your AWS Secret Manager secrets in an EKS cluster

How to access your AWS Secret Manager secrets in an EKS cluster This blog will show how we can use AWS secret manager inside AWS EKS pods. You all know that almost every application has sensitive data like usernames and passwords. To secure such sensitive data, AWS provides two ways to store and manage application […]

March 29, 2023

Anaytics, Big Data, Cloud

Best practices and hacks for Data Loading in Snowflake from Stages

Continuing our Snowflake blog series, after learning about setting up a  Snowflake account using System-defined Roles, we will explore the best practices for loading data from a file into Snowflake. Let’s begin.. Snowflake supports file-based data ingestion through Internal and External stages.  However, there are various factors to consider when performing data ingestion, including the […]

March 16, 2023

Anaytics, Big Data, Cloud

Snowflake Account setup using System defined roles

This is the first blog in a series that will focus on Snowflake, where we’ll cover best practices for using Snowflake, explore various Snowflake functionalities, discuss how to maximize the benefits of Snowflake, and address the challenges that come with its implementation or migration. In this blog, we’ll start by discussing setting up a Snowflake […]

February 16, 2023

AWS, Cloud, DevOps

Manage Stateful ECS Services using REX-Ray

Introduction We have been looking for a solution that would help us to mount hundreds of GBs of storage in the ECS tasks spawned by specific ECS services. ECS cluster does provide an option to increase the storage allocated to the tasks, but that applies to all the ECS services running inside the cluster. Sometimes, […]

November 24, 2022

AWS, Big Data, Cloud

Mirror Maker for Kafka Migration

For one of our Global Advertising Management Platform clients, we did one migration project with zero downtime for components like Platform DB, Ceph, Aerospike, Kafka (Zookeeper +data nodes), MapR (hive, oozie, hue), Druid (Zookeeper +data nodes), Flink (Zookeeper +data nodes), Monitoring (Icinga,collectd, cloudwatch), Logging (logstash & Opensearch) & Other Components ( Nexus, SFTP, Jenkins ). […]

October 31, 2022

Cloud, DevOps

Cloud pricing strategies

Three ways to improve cloud pricing strategies: 1. Think about how you will flow to the cloud Migrating current programs to the cloud do now not necessarily bring about instant fee savings. In fact, an easy “lift and circulate” migration can every so often result in better fees, mainly for packages that have been over-provisioned […]

October 4, 2022