remote
Web Scraping Specialist - MLabs
Software Engineer
Seeking a Web Scraping Specialist to build infrastructure for AI model training. Responsibilities include data gathering, process optimization, and scaling web data access.
About the role
Key Responsibilities
- Lead efforts to gather and analyze web data for AI model training.
- Optimize web scraping processes for efficiency and scalability.
- Support the scaling of high-quality public web data access.
- Contribute to building the infrastructure for massive web data delivery.
- Manage complex data ingestion and annotation pipelines.
Requirements
- Experience in web scraping and data extraction.
- Proficiency in relevant programming languages (e.g., Python).
- Understanding of data pipelines and distributed systems.
- Experience with AI model training data infrastructure is a plus.
- Ability to analyze and optimize data collection processes.
Skills
web scrapingdata engineeringpythonaidata pipelinesdistributed systems