onsite
Data Ops Engineer - Australian Payments Plus
Data Engineer
Data Ops Engineer building secure, scalable data pipelines on AWS, leveraging Python, SQL, Docker and Kubernetes to deliver real‑time payment insights and infrastructure for a leading payments platform.
About the role
Key Responsibilities
- Design, develop and maintain end‑to‑end data pipelines that ingest, transform and load payment data at scale.
- Implement robust data quality checks, monitoring and alerting to ensure data integrity across the ecosystem.
- Collaborate with data scientists, product and engineering teams to define data models and optimize query performance.
- Automate deployment and scaling of pipeline components using Docker, Kubernetes and CI/CD workflows.
- Ensure compliance with security, privacy and regulatory requirements for payment data.
Requirements
- Proven experience building data pipelines with Python and SQL on cloud platforms.
- Hands‑on expertise with AWS services such as S3, Redshift, Glue, Lambda and Step Functions.
- Strong knowledge of containerization (Docker) and orchestration (Kubernetes).
- Familiarity with data quality frameworks, monitoring tools and CI/CD pipelines.
- Excellent problem‑solving skills and a collaborative mindset.
Skills
pythonsqlawsdockerkubernetes