onsite
Data Platform Engineer - Apple
Data Engineer
Lead the design, build, and maintenance of scalable data pipelines and platforms using Python, SQL, and AWS services, ensuring high availability, performance, and data quality for enterprise analytics.
About the role
Key Responsibilities
- Design, develop, and maintain robust data pipelines and ETL processes using Python, SQL, and Spark on AWS.
- Implement and manage orchestration workflows with Airflow, ensuring reliable data flow and monitoring.
- Collaborate with data scientists and analysts to understand data requirements and deliver high‑quality datasets.
- Optimize data storage and processing for performance and cost efficiency across S3, Redshift, and EMR.
- Automate deployment and scaling of data services using Docker and Kubernetes.
- Ensure data security, compliance, and governance across all platforms.
Requirements
- 3+ years of experience in data engineering or platform development.
Skills
pythonsqlawsapache sparkairflowdockerkubernetes