remote
Senior Data Engineer - O'Brien Glass Industries
Data Engineer
Lead the design and implementation of a modern data platform, driving scalable data pipelines and analytics solutions using Python, Spark, and AWS services to empower enterprise decision‑making.
About the role
Key Responsibilities
- Architect, develop and maintain end‑to‑end data pipelines using Python, SQL and Apache Spark on AWS.
- Design and manage a scalable data lake and data warehouse to support analytics and reporting.
- Collaborate with data scientists, analysts and business stakeholders to translate requirements into robust data solutions.
- Implement data quality, governance and security best practices across the data ecosystem.
- Optimize performance and cost of data processing workloads on cloud infrastructure.
Requirements
- 5+ years of experience in data engineering with a strong background in Python and SQL.
- Hands‑on experience with Apache Spark, AWS services (S3, Redshift, Glue, EMR) and data lake architecture.
- Proven ability to design and deploy scalable, maintainable ETL pipelines.
- Strong analytical skills and a passion for data quality and governance.
- Excellent communication skills and ability to work cross‑functionally.
Skills
pythonsqlapache sparkaws