Introduction I’ll be honest when I say running a high-traffic production environment on AWS is fun…. until you see the cloud bill. At first, you overprovision a bit of memory “just to be safe.” Containers stay up a little longer than needed. Logs? Oh, we log everything because, you know, one day you might need it. And cross-AZ...
Introduction In ad-tech, logs are not “nice to have.” They are the product’s heartbeat. Every impression, every click, every bid request — everything generates logs. Multiply that by millions of requests per minute, and you’re suddenly dealing with millions of events and TB’s of logs per day. That’s exactly where one of our...
Introduction If you’ve worked in production long enough, you’ve probably heard this: “Let’s right-size the services and reduce the AWS bill.” So we do it. We check CPU and memory metrics for a week. We reduce task sizes. Costs drop. Everyone’s happy. And then…. six months later, the bill increases again....
Introduction Reducing cloud costs is always the top priority and biggest headache for Devops Engineers, especially when using managed AWS services like ECS Fargate. For one of our Ad-Tech clients at TO THE NEW, we were already utilising Fargate Spot to reduce the ECS bill significantly. But we found that we could save even more money if...
Introduction If you’ve ever worked with Kafka, you know the problem: data grows fast. Every click, impression, or event adds up, and before you know it, your Kafka broker's disks are full. Disk is not very cheap on AWS, and storing everything on expensive broker storage is costly, and scaling up to handle growth feels like throwing...
Introduction We used to rely on Pingdom for uptime monitoring. It worked well with simple checks, nice UI, and reliable and clean alerts. But one day, someone on our DevOps team casually said: "Hey, why are we paying for something that only pings URLs?" And that kicked off a big conversation. The Cost Wake-Up Pingdom wasn’t...
Nowadays, every org wants to migrate to a microservices architecture; the idea sounds great on paper. But when you're staring at an 8-year or decade-old monolith that processes millions of transactions and somehow never breaks, suggesting a complete rewrite feels... well, insane. I've been down this road more times than I care to admit....
Introduction The cloud computing market is going through rapid change and continuous improvement in terms of cost and performance. The Graviton processors manufactured by AWS utilize ARM architecture and are proving to be ground-breaking for cloud-based businesses. These Performance-Per-Watt metrics along with further enhancements will...
[caption id="attachment_64541" align="aligncenter" width="968"] Jenkins[/caption] Introduction In the Jenkins pipeline, long-running jobs can be a significant bottleneck, leading to resource inefficiencies and potentially delaying project timelines. Jenkins, a widely used automation server, offers powerful tools to manage and optimize...
With growing businesses in Amazon Web Services (AWS), finding idle resources, auditing your costs and managing your inventory are some of the most complex use-cases. This is particularly true for businesses or organizations that utilize a wide range of AWS services and resources, as keeping track of all these or idle resources can quickly...