A Data Engineer is needed to design and implement data pipelines for the Ads Auction Platform. The ideal candidate will have experience with Python, Apache Airflow, and Batch Processing. They will be responsible for ensuring the smooth operation of the data pipelines and implementing A/B Testing to optimize the platform's performance.
Key Responsibilities
- Design and implement data pipelines using Python and Apache Airflow.
- Ensure the smooth operation of the data pipelines and troubleshoot any issues that arise.
- Implement A/B Testing to optimize the platform's performance.
- Collaborate with cross-functional teams to identify areas for improvement and implement changes.
- Develop and maintain documentation for data pipelines and processes.
Requirements
- 3+ years of experience in data engineering with a focus on data pipelines.
- Proficiency in Python and Apache Airflow.
- Experience with Batch Processing and A/B Testing.
- Strong understanding of data architecture and data modeling.
- Excellent communication and collaboration skills.