onsite
Lead Data Engineer - KCI Technologies
Data Engineer
Lead a high‑performing data engineering team to design, build, and scale end‑to‑end data pipelines on cloud platforms using Python, Spark, Airflow, and AWS while ensuring robust data models and governance.
About the role
Key Responsibilities
- Architect, develop, and maintain scalable data pipelines and ETL processes on AWS using Python, Spark, and Airflow.
- Lead a team of data engineers, providing technical guidance, code reviews, and mentorship.
- Design and implement data models and warehouses that support analytics, reporting, and machine‑learning workloads.
- Collaborate with data scientists, analysts, and product owners to translate business requirements into reliable data solutions.
- Establish best practices for data quality, monitoring, security, and cost optimization.
Requirements
- 5+ years of hands‑on experience building large‑scale data pipelines in cloud environments (AWS preferred).
- Strong proficiency in Python, SQL, and big‑data frameworks such as Apache Spark.
- Experience with workflow orchestration tools like Apache Airflow or similar.
- Proven ability to lead and mentor engineering teams and drive technical decisions.
- Solid understanding of data modeling, data warehousing concepts, and data governance.
Skills
pythonsqlapache sparkaws