Pinned Loading

1. Building-a-data-warehouse-with-hive Building-a-data-warehouse-with-hive Public

   Building a complete data warehouse for an e-commerce application to perform Apache Hive analytics on various datasets using big data tools like Apache Sqoop, Apache Spark, and HDFS. In order to ach…

   Python 1

2. MySQL-kafka-S3-Redshift-pipeline MySQL-kafka-S3-Redshift-pipeline Public

   The MySQL Kafka S3 Redshift Pipeline enables real-time data transfer from MySQL to Redshift. Leveraging Kafka for streaming, S3 for storage, and Redshift for analytics, it ensures efficient, scalab…

   Python

3. AWS-Glue-Redshift-datawarehouse-ETL-pipeline AWS-Glue-Redshift-datawarehouse-ETL-pipeline Public

   Implement an AWS Glue ETL pipeline for data extraction, transformation, and loading into Amazon Redshift. Enhance data warehousing efficiency and analytics capabilities.

   Python

4. Build-ETL-Data-Pipeline-on-AWS-EMR-Cluster Build-ETL-Data-Pipeline-on-AWS-EMR-Cluster Public

   This Project goes over how to design a ELT system using AWS EMR and Hive. The main objective is to keep the code complexity and server management low, while automating as much as possible

   HiveQL

5. Real-Time-Credit-Card-Fraud-Transaction-Detection-system-using-Big-Data-Framework Real-Time-Credit-Card-Fraud-Transaction-Detection-system-using-Big-Data-Framework Public

   Here, implementing a credit card fraud detection system, by using big data technologies, like Hadoop, Spark, Apache Kafka

   Scala

6. AWS-Snowflake-Data-Pipeline-using-kinesis-and-Airflow AWS-Snowflake-Data-Pipeline-using-kinesis-and-Airflow Public

   The AWS Snowflake data pipeline, powered by Kinesis and Airflow, offers a robust solution for scalable, reliable, and automated data processing in the cloud

   Python