remote
Senior Web Scraping Engineer - teknobloom consulting
Software Engineer
Senior Web Scraping Engineer building scalable, high‑quality data extraction pipelines using Python, Scrapy, Playwright, Selenium, and .NET (C#), tackling dynamic sites and anti‑bot measures to deliver reliable data at scale.
About the role
Key Responsibilities
- Design, develop, and maintain scalable web scraping solutions for diverse client needs.
- Extract structured data from websites, APIs, and dynamic pages using Scrapy, Playwright, Selenium, and .NET (C#).
- Implement anti‑bot evasion techniques, handle CAPTCHAs, and manage session persistence.
- Integrate extracted data into downstream systems via APIs and SQL databases.
- Optimize performance, monitor job health, and troubleshoot failures in a Linux environment.
- Collaborate with data scientists and product teams to refine data quality and delivery pipelines.
Requirements
- 6–8 years of professional experience in web scraping and data extraction.
- Experience with HTTP debugging tools such as Fiddler or HTTP Toolkit.
- Excellent problem‑solving skills and ability to work independently in a remote setting.
Skills
pythonplaywrightseleniumsql