remote
Python Developer - Web Scraping Specialist 2 Years Experience - Enhance Tech Solutions
Software Engineer
Python Developer focused on building scalable web‑scraping pipelines with Scrapy, Spidermon, and Page Object Patterns, handling JavaScript‑rendered content and public APIs to extract structured data.
About the role
Key Responsibilities
- Design, develop, and maintain efficient web‑scraping spiders using Python and Scrapy.
- Implement AI Spider Templates and Page Object Patterns to create modular, reusable scraping components.
- Extract structured and unstructured data from public APIs and dynamic web content, ensuring data quality and consistency.
- Handle challenges involving JavaScript‑rendered pages, HTTP/web protocols, and complex HTML/CSS structures.
- Integrate Spidermon for monitoring, logging, and automated error handling across scraping workflows.
- Collaborate with data engineering and analytics teams to refine data models and improve extraction performance.
Requirements
- 2+ years of professional experience in Python development with a focus on web scraping.