GitHub - svc98/Real_Estate_Webscrape_Stream: Developed a fault-tolerant pipeline with Airflow to scrape Redfin listings, using Kafka for event-driven ingestion and Spark for real-time processing, ensuring scalable and low-latency housing market analytics.

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 4 Commits
.idea		.idea
airflow/logs		airflow/logs
dags		dags
docker		docker
RealEstate_Stream.iml		RealEstate_Stream.iml
docker-compose.yml		docker-compose.yml
system_architecture.png		system_architecture.png

About

Developed a fault-tolerant pipeline with Airflow to scrape Redfin listings, using Kafka for event-driven ingestion and Spark for real-time processing, ensuring scalable and low-latency housing market analytics.

slomochacko242.wixsite.com/portfolio/real-estate-webscrape-stream

python airflow kafka spark cassandra openai-api