Python Developer - Web Scraping & Data Pipeline Automation
We aggregate real estate listings data from 14 different websites and currently do this manually. We need a Python developer to build automated scrappers for all 14 sources using Playwright or Scrapy, handle antu-bot measures (rotating proxies, CAPTCHA solving), normalize the data into a unified PostgreSQL schema, schedule daily runs via Airflow or AWS Lambda, and build a simple monitoring dashboard to flag scraper failures. Must have prior experience with at least one of the target sites (Zillow, Redfin, Realton.com). NDA required before sharing full site list.
