Pinned Loading

1. autopredict autopredict Public

   auto-predict is a python library to automate building of prediciton models,feature selection and some more handy utilities used in building prediction models.

   Python 2

2. Airflow-Batch-Pipeline-S3-Redshift Airflow-Batch-Pipeline-S3-Redshift Public

   Data pipeline that has been designed to automate the parsing of user search patterns from logs of a property hosting website. The pipeline extracts data from S3 , massages the data and puts the fin…

   Jupyter Notebook

3. Airflow-Monitoring-ElasticSearch-LogStash-Kibana Airflow-Monitoring-ElasticSearch-LogStash-Kibana Public

   In this project we look to set up Airflow monitoring using ElasticSearch-LogStash-Kibana (ELK stack). We will set up the stack using docker images.

   Shell 3 3

4. Data-Streaming-Using-Aws-Kinesis-Lambda-S3 Data-Streaming-Using-Aws-Kinesis-Lambda-S3 Public

   A production grade data pipeline that streams real time data of an online retailer website into AWS S3 data lake. The pipeline uses AWS Kinesis to receive real time streaming data and a lambda cons…

   Python

5. Forex-Currency-Processing-Airflow-Hdfs-Hive-Spark Forex-Currency-Processing-Airflow-Hdfs-Hive-Spark Public

   We build a Forex-currency rates pipeline to get currency rates from an external API and load the data into HDFS from where we use pyspark job to massage the data and insert it into a Hive table. Th…

   Shell 1

6. genai-prod-catalog-enrichment genai-prod-catalog-enrichment Public

   Gen AI tool for product catalog extraction

   Python