For this project, my primary responsibility was to set up the CI/CD pipeline and automate the database. The aim of my part was to automate the deployment of MySQL and MongoDB, run the ETL process ...

This project develops a basic data pipeline for an event ticketing system, integrating CSV-based vendor feeds with a relational database. The system simulates how major ticket platforms manage direct ...

Department of Chemical and Biomolecular Engineering, School of Energy Science and Engineering, Vidyasirimedhi Institute of Science and Technology, Rayong 21210, Thailand ...

Google Colab, also known as Colaboratory, is a free online tool from Google that lets you write and run Python code directly in your browser. It works like Jupyter Notebook but without the hassle of ...

Abstract: Cloud-based data pipelines are critical for large-scale ETL and big data analytics, yet in-efficient scheduling leads to high costs and resource underutilization. Traditional approaches, ...

Functions are the building blocks of Python programming. They let you organize your code, reduce repetition, and make your programs more readable and reusable. Whether you’re writing small scripts or ...

The latest trends and issues around the use of open source software in the enterprise. JetBrains has detailed its eighth annual Python Developers Survey. This survey is conducted as a collaborative ...

Abstract: Data Integration is the process of combining data from different sources to support Data Analytics in organizations. The best definition of data integration is given by IBM, stating “Data ...