remote
Team Leader Data Engineering - John Deere
Software Engineer
Lead a high‑performing data engineering team, designing and scaling data pipelines with Python, Spark, Hadoop, and AWS services to deliver actionable insights for business stakeholders.
About the role
Key Responsibilities
- Lead and mentor a cross‑functional data engineering team, setting technical direction and ensuring high‑quality deliverables.
- Design, develop, and maintain scalable data pipelines using Python, Apache Spark, and Hadoop on AWS infrastructure.
- Collaborate with data scientists, product managers, and stakeholders to translate business requirements into robust data solutions.
- Implement best practices for data quality, governance, and security across the data platform.
- Optimize performance and cost of data workflows, leveraging AWS services such as S3, EMR, Glue, and Redshift.
Requirements
- 5+ years of experience in data engineering with a strong background in Python and big‑data technologies.
- Proven expertise in Apache Spark, Hadoop, and AWS data services.
- Hands‑on experience with SQL and data modeling for analytical workloads.
- Excellent leadership and communication skills, with a track record of building and scaling high‑performing teams.
- Strong problem‑solving abilities and a passion for continuous improvement.
Skills
pythonapache sparkhadoopawssql