Data Modelling: Star, Snowflake, Galaxy Schema
With the growth of AI in data engineering, finding scalable ways to model your data has become more important. Modelling your data often involves choosing between star, snowflake, and galaxy schemas, each with its strengths and weaknesses. The schema is the architectural blueprint for a well-organized, related, and stored dataset for analytical processing. The choice […]
What is Medallion Architecture?
For proper data management, we need to organize our data to keep a clean data ecosystem and make data decisions more efficient and easy to find. The Medallion architecture does just that, it’s a data design pattern that organizes data into layers to progressively improve its quality, structure, and usability through transformation. The Medallion Architecture […]
OLTP or OLAP – Choosing the Right Data Processing Architecture
You’re about to design your data ecosystem and wondering what works best for your use case, OLTP or OLAP? Understanding your options and alternatives is crucial for success, and that’s exactly what I’ll cover in this post. In data processing, Online Transaction Processing (OLTP) and Online Analytical Processing (OLAP) represent two fundamental approaches that serve […]