onsite
Senior Data Platform Engineer - ionna
Data Engineer
Design, build, and maintain scalable data platforms using Python, SQL, and cloud services. Lead data pipeline development, ensure high‑performance processing with Spark and Kafka, and drive best practices for data modeling and governance.
About the role
Key Responsibilities
- Architect and implement end‑to‑end data pipelines on AWS, leveraging services such as S3, Redshift, and Glue.
- Develop high‑throughput data processing jobs using Python, Apache Spark, and Kafka for real‑time and batch workloads.
- Design robust data models and schemas to support analytics, reporting, and machine‑learning initiatives.
- Collaborate with cross‑functional teams to define data requirements, ensure data quality, and optimize performance.
- Establish and enforce best practices for data governance, security, and documentation.
Requirements
- 5+ years of experience building large‑scale data platforms in a cloud environment, preferably AWS.
- Strong proficiency in Python and SQL, with hands‑on experience in Apache Spark and Kafka.
- Deep understanding of data modeling, ETL/ELT processes, and data warehousing concepts.
- Experience with infrastructure‑as‑code tools (e.g., Terraform, CloudFormation) and CI/CD pipelines.
- Excellent problem‑solving skills and ability to work autonomously in a fast‑paced environment.
Skills
pythonsqlawsapache sparkkafka