onsite
Data Engineer - CENTCOM - Agile Defense
Data Engineer
Data Engineer supporting CENTCOM missions, designing and operating scalable data pipelines on AWS, building ETL workflows with Python and Airflow, and delivering reliable analytics through Snowflake and SQL.
About the role
Key Responsibilities
- Design, develop, and maintain robust data pipelines to ingest, transform, and load mission-critical data from diverse sources.
- Implement ETL processes using Python, SQL, and Apache Airflow to ensure data quality, reliability, and timeliness.
- Architect and optimize data storage solutions on AWS services such as S3, Redshift, and Snowflake for high‑performance analytics.
- Collaborate with analysts, scientists, and security teams to define data models that support operational reporting and decision‑making.
- Monitor pipeline performance, troubleshoot issues, and apply best practices for security and compliance in a Top‑Secret environment.
Requirements
- Proven experience building data pipelines with Python, SQL, and workflow orchestration tools (e.g., Apache Airflow).
- Strong knowledge of AWS data services (S3, Redshift, Snowflake) and cloud‑based data architecture.
- Hands‑on experience with ETL design, data modeling, and performance tuning for large datasets.
- Ability to obtain and maintain a Top‑Secret clearance; prior experience in defense or intelligence domains is a plus.
- Excellent problem‑solving skills and the ability to work autonomously in a fast‑paced, mission‑focused environment.
Skills
pythonsqlawssnowflake