remote
Senior Data Platform Consultant
Software Engineer
Lead design and implementation of scalable data platforms on AWS and Azure, integrating CI/CD pipelines and advanced classification models to deliver robust, high‑performance data solutions.
About the role
Key Responsibilities
- Architect and deploy end‑to‑end data pipelines on AWS and Azure, ensuring scalability, reliability, and security.
- Design and maintain CI/CD workflows for data engineering artifacts, leveraging tools such as GitHub Actions, Azure DevOps, or Jenkins.
- Implement and tune classification models, integrating them into production pipelines and monitoring their performance.
- Collaborate with cross‑functional teams to translate business requirements into technical specifications and data solutions.
- Provide mentorship and technical guidance to junior engineers and stakeholders on best practices.
Requirements
- 5+ years of experience in data engineering with a strong focus on cloud platforms (AWS, Azure).
- Proven expertise in CI/CD pipeline creation and automation for data workflows.
- Hands‑on experience building and deploying classification models at scale.
- Strong scripting skills (Python, Bash) and familiarity with data orchestration tools (Airflow, Databricks).
- Excellent communication skills and ability to work in a collaborative, fast‑paced environment.