onsite
Data Engineer II - Ann & Robert H. Lurie Children's Hospital of Chicago
Data Engineer
Data Engineer II responsible for designing, building, and optimizing data pipelines and warehouses using Python, SQL, Spark, and AWS services to support product and analytics teams.
About the role
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL processes using Python, SQL, and Apache Spark.
- Implement and manage data warehousing solutions on AWS (Redshift, S3, Glue) to support analytics and reporting.
- Collaborate with product owners, business analysts, and data scientists to understand data requirements and deliver high‑quality data assets.
- Optimize query performance, data storage, and pipeline throughput through indexing, partitioning, and caching strategies.
- Monitor, troubleshoot, and document data workflows using Airflow and other orchestration tools.
- Ensure data quality, governance, and security compliance across all data assets.
Requirements
- 3+ years of experience as a data engineer or similar role.
Skills
pythonsqlawsapache sparkairflow