remote
Python Developer - Web Data Extraction & AI - FullStackTechies
Software Engineer
Senior Python developer skilled in advanced web scraping, browser automation, and large‑scale data extraction using Playwright, Selenium, Scrapy, and related libraries, with expertise in handling dynamic JavaScript sites, authentication, proxies, and CAPTCHA challenges.
About the role
Key Responsibilities
- Design, develop, and maintain robust Python‑based web scraping pipelines for dynamic, JavaScript‑heavy websites.
- Implement browser automation solutions using Playwright and Selenium to navigate complex DOM structures, manage sessions, cookies, and proxies.
- Integrate data extraction modules with Scrapy, Requests, and BeautifulSoup, ensuring high‑quality, structured output for downstream AI and analytics workflows.
- Optimize scraping performance, handle CAPTCHA and anti‑bot measures, and troubleshoot extraction failures in production environments.
- Collaborate with data engineering and AI teams to refine data schemas, improve extraction accuracy, and support large‑scale data ingestion.
Requirements
- 2–7 years of professional experience in Python web scraping and browser automation.
Skills
pythonplaywrightselenium