Category
Sort By
In the previous blog we understood how to Optimally use Snowflake Warehouse and Tables. So let’s continue the blog series, where we will now focus on improving the performance in Snowflake and its associated costs. As we know, Snowflake tables are micro-partitioned, which significantly improves query performance. However, over time, you may experience slowness in […]
With growing businesses in Amazon Web Services (AWS), finding idle resources, auditing your costs and managing your inventory are some of the most complex use-cases. This is particularly true for businesses or organizations that utilize a wide range of AWS services and resources, as keeping track of all these or idle resources can quickly become […]
In the previous blog, we discussed the Best practices to be followed while Data loading into Snowflake from Stages. Continuing the snowflake blog series lets us understand how to use Snowflake Warehouse and Tables optimally. Snowflakes Virtual Warehouses Virtual Warehouses is one of the critical components in Snowflake architecture and deciding the correct configurations for […]
How to access your AWS Secret Manager secrets in an EKS cluster This blog will show how we can use AWS secret manager inside AWS EKS pods. You all know that almost every application has sensitive data like usernames and passwords. To secure such sensitive data, AWS provides two ways to store and manage application […]
Continuing our Snowflake blog series, after learning about setting up a Snowflake account using System-defined Roles, we will explore the best practices for loading data from a file into Snowflake. Let’s begin.. Snowflake supports file-based data ingestion through Internal and External stages. However, there are various factors to consider when performing data ingestion, including the […]
This is the first blog in a series that will focus on Snowflake, where we’ll cover best practices for using Snowflake, explore various Snowflake functionalities, discuss how to maximize the benefits of Snowflake, and address the challenges that come with its implementation or migration. In this blog, we’ll start by discussing setting up a Snowflake […]
Introduction We have been looking for a solution that would help us to mount hundreds of GBs of storage in the ECS tasks spawned by specific ECS services. ECS cluster does provide an option to increase the storage allocated to the tasks, but that applies to all the ECS services running inside the cluster. Sometimes, […]
For one of our Global Advertising Management Platform clients, we did one migration project with zero downtime for components like Platform DB, Ceph, Aerospike, Kafka (Zookeeper +data nodes), MapR (hive, oozie, hue), Druid (Zookeeper +data nodes), Flink (Zookeeper +data nodes), Monitoring (Icinga,collectd, cloudwatch), Logging (logstash & Opensearch) & Other Components ( Nexus, SFTP, Jenkins ). […]
Three ways to improve cloud pricing strategies: 1. Think about how you will flow to the cloud Migrating current programs to the cloud do now not necessarily bring about instant fee savings. In fact, an easy “lift and circulate” migration can every so often result in better fees, mainly for packages that have been over-provisioned […]