Middle Python Scraping Developer

Dataforest is seeking a Middle Python Scraping Developer to join their team. The role focuses on developing and optimizing web scraping solutions, designing ETL pipelines, and implementing anti-bot evasion strategies. The company offers a friendly work environment with flexible scheduling and international collaboration opportunities.

• Develop, maintain, and optimize web scraping and parsing solutions
• Design and implement APIs, ETL pipelines, and data integration services
• Work closely with Project Managers to address customer requirements and challenges
• Ensure performance optimization and efficiency of data collection pipelines
• Collaborate with team members, participate in meetings, brainstorming sessions, and code reviews
• Implement anti-bot evasion strategies to enhance scraping reliability

• 2+ years of commercial experience with Python
• Proficiency in web scraping, data extraction, cleaning, and visualization
• Strong XPath expertise for designing robust expressions
• Experience with web automation tools: Playwright, playwright-stealth, Requests, aiohttp, hrequests, lxml
• Deep understanding of anti-bot protection and CAPTCHA solving techniques
• Experience with structured logging, traceability, and monitoring pipelines
• Strong understanding of multiprocessing and multithreading
• Familiarity with Linux environments, AWS, GCP, and Docker
• Experience with SQL databases (PostgreSQL, MySQL)
• Experience with Flask/Flask-RESTful for API development
• Optional: NoSQL databases, Pandas data analysis

Schedule & Environment: Flexible work schedule, friendly working environment with minimal hierarchy

Benefits: Competitive salary in USD, paid vacation and sick leaves, team building activities, corporate events, personal and professional development opportunities, challenging tasks with interesting projects using new technologies, networking opportunities with international clients