onsite
Senior Data Engineer - Operations - U.S. Bank
Data Engineer
Lead the design, development, and maintenance of scalable data pipelines and lakehouse solutions using Python, SQL, AWS, and Spark to empower data-driven decisions across the organization.
About the role
Key Responsibilities
- Architect, build, and optimize large-scale data pipelines and lakehouse environments on AWS, ensuring high performance and reliability.
- Develop and maintain ETL workflows using Python, SQL, and Apache Spark, transforming raw data into clean, analytics-ready datasets.
- Collaborate with data scientists, analysts, and product teams to understand data requirements and deliver actionable insights.
- Implement data quality checks, monitoring, and alerting to guarantee data integrity and availability.
- Document data models, pipeline logic, and best practices for future reference and knowledge sharing.
Requirements
- 5+ years of experience in data engineering, with a strong focus on cloud-based data platforms.
Skills
pythonsqlawsapache spark