onsite
Chief Engineer - Engineering Data Platform - Commonwealth Bank of Australia
Software Engineer
Lead the design and evolution of a secure, scalable engineering data platform, driving data‑driven insights, AI capabilities, and operational resilience using Python, AWS, and modern data engineering practices.
About the role
Key Responsibilities
- Architect and evolve a cloud‑native data platform that ingests, stores, and serves engineering telemetry at scale.
- Define data governance, security, and compliance frameworks to protect sensitive engineering data.
- Collaborate with cross‑functional teams to deliver reusable data products that enable AI‑driven engineering insights.
- Champion best practices in CI/CD, observability, and automated testing for data pipelines.
- Mentor and guide engineering teams on data architecture, tooling, and performance optimization.
Requirements
- 10+ years of experience in data engineering, with a strong background in Python and AWS services (Redshift, Glue, S3, Lambda).
- Proven track record designing scalable, secure data pipelines and data lake architectures.
- Deep knowledge of machine learning workflows and how to embed ML into engineering processes.
- Experience with DevOps practices, CI/CD, and infrastructure as code (Terraform, CloudFormation).
- Excellent communication skills and a collaborative mindset to influence stakeholders across the organization.
Skills
pythonawsmachine learningcicd