hireclover
All jobs

Forecasa

Data Engineer Web Scraping/Data Quality (AI-Augmented)

Remote Middle $2.5k–$8.4k/moest.

Summary

Forecasa is a U.S.-based data startup delivering high-quality real estate data and analytics to lenders and investors. We're seeking a Data Engineer to join the Data Acquisition & Quality team, scaling and improving systems that collect, validate, and monitor data powering the platform. You'll work with AI-augmented development workflows and modern data infrastructure.

What you'll do

  • Develop and maintain Python-based web scrapers using AI coding assistants while applying judgment on reliability and edge cases
  • Use Selenium, BeautifulSoup, Pandas, and PySpark to extract and normalize data efficiently
  • Package scrapers as Docker containers and deploy them to Kubernetes
  • Create and manage Airflow DAGs to orchestrate scraping pipelines
  • Build data validation pipelines to catch anomalies, missing values, and inconsistencies
  • Review and refine AI-generated code for production reliability
  • Set up Grafana dashboards to monitor pipeline health and data quality metrics

Requirements

  • Solid Python experience, especially building web scrapers
  • Familiarity with Selenium, BeautifulSoup, or Scrapy
  • Some experience with Docker, Airflow, or other orchestration tools
  • Active use of AI coding tools (Claude Code, Cursor, Copilot, etc.) with opinions about workflows
  • Strong code review instincts for both human and AI-generated code
  • Resourceful problem-solving mindset
  • Bonus: Grafana or Prometheus monitoring experience, cloud platform exposure (AWS preferred), CI/CD and Git workflows (GitLab)

Conditions

Location: Remote - candidates welcome from anywhere in the world

Schedule & Culture: Small, fast-moving team with strong engineering culture focused on AI-augmented development

Browse jobs