Web Scraping Developer - Growth Leads

Growth Leads is an online lead generation company that creates quality leads in highly competitive verticals, such as iGaming, Financials, Health and Communications. We focus on building high-end websites with quality content that let customers make an informed decision about the product they’re about to buy or sign-up to. We pride ourselves on adopting a customer-focused approach to quality and usability.

About the Role

We are seeking an experienced Web Scraping Developer to join our data acquisition team. In this role, you will be responsible for designing, developing, and maintaining automation solutions that interact with websites, APIs, email systems, Google Sheets, and other external platforms. The primary objective of these automations is to collect affiliate and market intelligence data from various sources and integrate it into our centralized data warehouse.

What you'll do

• Design, develop, and maintain web scraping and automation solutions.
• Build integrations with websites, APIs, email platforms, spreadsheets, and other third-party systems.
• Extract, transform, and load (ETL) data into the company's data warehouse.
• Monitor and maintain existing scraping infrastructure to ensure reliability and scalability.
• Analyze, troubleshoot, and adapt to changes in target systems and anti-bot mechanisms.
• Collaborate with internal teams to define data collection requirements and optimize data pipelines.

What we're looking for

• Strong proficiency in Python.
• Experience using UV for Python dependency and environment management.
• Daily development experience in Linux environments.
• Solid knowledge of PostgreSQL.
• Experience with Docker.
• Experience working with AWS services.
• Proficiency with Git, particularly GitHub.
• Hands-on experience with browser automation frameworks: e.g., Selenium
• Experience with HTTP clients: e.g. requests
• CSS Selectors and XPath
• Proxy rotation and management
• JavaScript injection and DOM manipulation
• Browser fingerprint spoofing and rotation
• Scraping dynamic and JavaScript-heavy websites

Preferred Qualifications (Nice to Have)

• Experience bypassing anti-bot and anti-scraping systems. Familiarity with advanced browser evasion techniques and detection avoidance strategies.

CAPTCHA solving services

Network request analysis and reverse engineering