onsite
Senior Software Engineer - Visionist, INC
Software Engineer
Senior Software Engineer driving large‑scale data processing pipelines using Python, Java, Spark and Hadoop on AWS, with a focus on secure, mission‑critical analytics and automated CI/CD delivery.
About the role
Key Responsibilities
- Design, develop, and optimize high‑performance data processing pipelines for massive, classified datasets.
- Implement scalable analytics solutions using Apache Spark, Hadoop, Python and Java to transform raw data into actionable intelligence.
- Integrate cloud services (AWS) and containerized environments to ensure secure, reliable, and repeatable deployments.
- Collaborate with analysts and security teams to translate mission requirements into robust software architectures.
- Maintain CI/CD pipelines, automated testing, and monitoring to guarantee continuous delivery and operational excellence.
Requirements
- Active TS/SCI clearance with polygraph.
- 5+ years of professional experience in large‑scale data engineering, preferably in government or intelligence environments.
- Proficiency in Python and Java, with hands‑on experience in Apache Spark and Hadoop ecosystems.
- Strong knowledge of AWS services (EC2, S3, Lambda, EMR) and container orchestration (Docker, Kubernetes).
- Demonstrated ability to build and maintain CI/CD pipelines using tools such as Jenkins, GitLab CI, or similar.
Skills
pythonjavaapache sparkhadoopawscicd