onsite
Dynamite Data Engineer - Black Cape
Data Engineer
Senior Data Engineer driving enterprise data pipelines with Python, Spark, and AWS, building scalable ETL workflows and infrastructure-as-code solutions to support mission‑critical analytics across the DMV region.
About the role
Key Responsibilities
- Design, develop, and maintain large‑scale data pipelines using Python, Apache Spark, and AWS services (Glue, Redshift, S3).
- Implement robust ETL processes, ensuring data quality, lineage, and performance optimization.
- Collaborate with data scientists and analysts to translate business requirements into technical solutions.
- Manage infrastructure-as-code with Terraform, automating deployment and scaling of data platforms.
- Monitor pipeline health, troubleshoot issues, and continuously improve reliability and efficiency.
Requirements
- Minimum 2+ years of senior-level data engineering experience.
- Proficiency in Python, SQL, and Spark for data transformation.
- Hands‑on experience with AWS data services and Terraform.
- Strong analytical skills and ability to work in a fast‑paced environment.
- Active TS/SCI clearance and U.S. citizenship required.
Skills
pythonsqlapache sparkawsterraform