Airflow Bike Share ETL

A fully automated ETL pipeline for bike share data using Apache Airflow. Extracts live data, transforms it into analytics-ready Parquet files, and loads it into S3/PostgreSQL for analysis.

• Python & Apache Airflow
• Pandas & PyArrow for optimized data processing
• Cloud Integration: AWS S3 & PostgreSQL
• BytesIO for memory-efficient data handling

View on GitHub

Fixedgearsolace.com

Deployed on AWS EC2 with Nginx, Gunicorn, PostgreSQL, and media handling. Utilizes affiliate links and gear recommendations.

• Python & Django
• HTML & CSS
• Cloud Integration: AWS EC2
• Media Handling & Affiliate Links

View On Github

Web Scraper To AWS S3

Utilizing Beautiful Soup to web scrape quotes, convert to JSON and store in AWS S3 bucket.

• Python
• Beautiful Soup
• Cloud Integration: AWS S3
• Data Storage & JSON

View On Github