remote
Senior Context Engineer - Data Engineering - UPS
Software Engineer
Lead enterprise data initiatives as a Senior Context Engineer, designing and optimizing large‑scale data pipelines using Python, Spark, and AWS services to deliver actionable insights across the organization.
About the role
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and workflows that ingest, transform, and store enterprise data.
- Collaborate with data scientists, analysts, and business stakeholders to define data requirements and ensure data quality and integrity.
- Implement best practices for data modeling, metadata management, and governance across cloud and on‑prem environments.
- Optimize performance of SQL and Spark jobs, leveraging AWS services such as Redshift, S3, and Glue.
- Mentor junior engineers and drive continuous improvement of data engineering processes and tooling.
Requirements
- 5+ years of experience in data engineering with a strong background in Python, SQL, and Spark.
- Proven expertise in AWS data services (Redshift, Glue, S3, EMR) and data lake architecture.
- Deep understanding of data modeling, ETL design, and data governance principles.
- Excellent problem‑solving skills and ability to work in a fast‑paced, collaborative environment.
- Strong communication skills and experience mentoring junior team members.
Skills
pythonsqlapache sparkaws