The Olist E-Commerce project is a comprehensive data engineering and business intelligence (BI) solution designed to handle and analyze the data generated by Olist ,a Brazilian e-commerce platform.This project aims to implement a data warehouse for Olist E-commerce data, Perform ETL processes using SSIS and implementing incremental load and slowly changing dimensions (SCD)(Type 0 , Type 1 ,Type 2), and create reports using (SSRS) and visualize the data using Power BI to provide valuable insights into Olist's operations.
As a Data Engineer and BI Developer, I have architected and implemented this solution.
Using Olist E-Commerce dataset as the source of our data (9 csv files). The dataset has information of 100k orders from 2016 to 2018 made at multiple marketplaces in Brazil. You can find the dataset [here] [https://www.kaggle.com/datasets/olistbr/brazilian-ecommerce]
I developed Data warehouse based on a star schema and identified fact tables is Fact_orders. On the other hand, identified dimension tables are Dim_costomer, Dim_seller, Dim_product, Dim_date,Dim_Payment
By using SSIS, I perform ETL process involves extracting data from Csv files, transforming it to fit our data warehouse schema, and loading it,also i have implemented incremental loading and SCD types to efficiently manage data updates.
I generate various reports using SQL Server Reporting Services (SSRS) to provide insights into the Olist eCommerce data.
To visualize our data, I use Power BI. I have created interactive dashboards and visualizations to get insights from it. you can Find it in this Link [https://www.novypro.com/project/olist-ecommerce-power-bi]