onsite
Senior Data Engineer - Government & Public Sector AI & Data - Ernst & Young
Data Engineer
Senior Data Engineer driving AI and data solutions for government clients, leveraging Python, SQL, AWS, and data lake architectures to deliver secure, scalable analytics platforms.
About the role
Key Responsibilities
- Design, develop, and maintain large-scale data pipelines and lakehouse solutions on AWS for federal, state, and local government clients.
- Implement robust data ingestion, transformation, and quality checks using Python, Spark, and SQL.
- Collaborate with data scientists and security teams to ensure compliance with government data security standards and maintain required clearance.
- Optimize performance and cost of data workflows, applying best practices in cloud architecture and automation.
- Document architecture, processes, and provide mentorship to junior engineers.
Requirements
- 5+ years of data engineering experience in a regulated environment.
- Proficiency in Python, SQL, and AWS services (Glue, Redshift, S3, Lake Formation).
- Hands‑on experience with data lake and lakehouse patterns, Spark, and ETL orchestration.
- Strong understanding of data security, privacy regulations, and experience maintaining security clearance.
- Excellent communication skills and ability to translate business needs into technical solutions.
Skills
pythonsqlawsmachine learning