onsite
Assistant Director, Data Engineering - University of Colorado System Administration
Software Engineer
Lead data engineering initiatives, designing and maintaining scalable data pipelines using Python, SQL, Spark, and AWS to support research and institutional analytics across the University of Colorado system.
About the role
Key Responsibilities
- Architect, develop, and maintain robust data pipelines and workflows to ingest, transform, and store large volumes of institutional data.
- Collaborate with data scientists, analysts, and stakeholders to define data requirements and deliver actionable insights.
- Implement and optimize ETL processes using Python, SQL, and Apache Spark on AWS infrastructure.
- Ensure data quality, governance, and security compliance across all data assets.
- Mentor junior engineers and promote best practices in data engineering and DevOps.
Requirements
- 5+ years of experience in data engineering or related field.
- Proficiency in Python, SQL, and Spark for large‑scale data processing.
- Hands‑on experience with AWS services (EMR, S3, Redshift, Glue).
- Strong understanding of data modeling, ETL design, and data governance principles.
- Excellent communication skills and ability to work cross‑functionally in an academic environment.
Skills
pythonsqlapache sparkaws