onsite
Data Engineer with Security Clearance - Staffed4U LLC
Data Engineer
Data Engineer with active TS/SCI clearance, responsible for designing, building, and maintaining large-scale data pipelines on AWS, leveraging Python, SQL, Spark, and Airflow to support intelligence community missions.
About the role
Key Responsibilities
- Design, develop, and maintain scalable data pipelines ingesting terabytes of structured and unstructured data from multiple sources.
- Implement data transformation, cleansing, and enrichment using Python, SQL, and Apache Spark on AWS EMR.
- Orchestrate workflows with Apache Airflow, ensuring reliability, monitoring, and automated alerting.
- Collaborate with data scientists and analysts to deliver high-quality datasets for mission-critical analytics.
- Enforce data security and compliance standards, maintaining strict adherence to TS/SCI clearance requirements.
Requirements
- Active TS/SCI clearance with Full Scope Polygraph (FSP).
- 3+ years of experience in data engineering, preferably in a government or intelligence environment.
- Proficiency in Python, SQL, and AWS services (S3, Redshift, Glue, EMR).
- Hands‑on experience with Spark, Airflow, and data modeling best practices.
- Strong problem‑solving skills and ability to work independently in a high‑security setting.
Skills
pythonsqlawsapache sparkairflow