TO THE NEW Blog PAGES

DevOps

Boosting ECS Costs Savings: Moving to Graviton with Fargate Spot

Introduction Reducing cloud costs is always the top priority and biggest headache for Devops Engineers, especially when using managed AWS services like ECS Fargate. For one of our Ad-Tech clients at TO THE NEW, we were already utilising Fargate Spot to reduce the ECS bill significantly. But we found that we could save even more […]

DevOps

From Hot Brokers to S3: Optimizing Kafka Storage with Tiered Storage

Introduction If you’ve ever worked with Kafka, you know the problem: data grows fast. Every click, impression, or event adds up, and before you know it, your Kafka broker’s disks are full. Disk is not very cheap on AWS, and storing everything on expensive broker storage is costly, and scaling up to handle growth feels […]

Data Engineering

How GenAI Is Transforming Data Engineering

Introduction Data engineering, once dominated by manual coding, SQL development, and repetitive operational tasks, is entering a new era. With Generative AI (GenAI), data teams are automating ingestion workflows, accelerating data modeling, writing code faster, improving quality checks, and generating documentation instantly. GenAI isn’t just an add-on—it is fundamentally transforming how modern data platforms are […]

Python

Exploring Agentic AI for Automation

The other day, my client asked for something that sounded simple at first – he wanted an alert in his inbox whenever the date changed on a specific website. And, of course, the first thought that came to my mind was: “Yes, that’s doable with Python!” Because that’s what I have always done in my […]

Data Science

GCP: Building a RAG Pipeline with AlloyDB AI and Vertex AI

One Database, Infinite Context: Why Your Next RAG App Should Start in SQL: The biggest challenge in Generative AI is “hallucination.” Retrieval-Augmented Generation (RAG) solves this by giving an LLM access to your private data. While most RAG stacks require complex Python “glue code,” Google Cloud’s AlloyDB AI allows you to handle the entire retrieval […]

Data Science

MCP : Model Context Protocol

Introduction If you’ve built anything around LLMs – chatbots, internal assistants, developer tools—you’ve probably hit the same wall: the model is smart, but it’s “trapped.” It can’t directly fetch the latest numbers from your database, read files from your system, or trigger real workflows unless you wire everything up manually. That’s where MCP (Model Context […]