bishal.singh

Bishal Singh is a Software Engineer at To The New with 1 year of experience in Data Engineering. He is in India BU of To The New. He has an experience in Big Data tools and technologies. He has worked in a finance domain.

Big Data, Data & Analytics

Enhancing Workflows with Apache Airflow and Docker

In today's world, handling complex tasks and automating them is crucial. Apache Airflow is a powerful tool that helps with this. It's like a conductor for tasks, making everything work smoothly. When we use Airflow with Docker, it becomes even better because it's flexible and can be easily moved around. In this blog, we'll explain what...

17-Oct-2023

Big Data, Data & Analytics

Efficient Data Migration from MongoDB to S3 using PySpark

Data migration is a crucial process for modern organizations looking to harness the power of cloud-based storage and processing. The blog will examine the procedure for transferring information from MongoDB, a well-known NoSQL database, to Amazon S3, an elastic cloud storage solution leveraging PySpark. Moreover, we will focus on handling...

18-Sep-2023