onsite
Software Engineer - Data Engineering Security Clearance Required - Anduril Industries
Software Engineer
Senior data engineer building secure, scalable pipelines that ingest, transform, and serve real‑time data for AI‑driven defense systems, leveraging Python, SQL, and AWS services under a required security clearance.
About the role
Key Responsibilities
- Design, develop, and maintain high‑throughput data pipelines that ingest diverse sensor streams into a unified data lake.
- Implement robust ETL processes using Python, SQL, and AWS Glue to transform raw data into analytics‑ready formats.
- Collaborate with data scientists and security teams to ensure data integrity, privacy, and compliance with defense regulations.
- Optimize pipeline performance and cost through efficient use of cloud resources and caching strategies.
- Document architecture, data models, and operational procedures for internal and external stakeholders.
Requirements
- 5+ years of experience in data engineering, with a strong background in Python and SQL.
- Proficiency with AWS services (S3, Redshift, Glue, Lambda) and experience building scalable, fault‑tolerant pipelines.
- Hands‑on experience with ETL frameworks and data lake architectures.
- Strong understanding of security best practices and experience working within a security‑cleared environment.
- Excellent problem‑solving skills and the ability to communicate complex technical concepts to cross‑functional teams.