onsite
Senior IT Big Data Developer - Diverse Agile Solutions
Software Engineer
Senior IT Big Data Developer leading large‑scale data pipelines and analytics solutions using Spark, Hadoop, and AWS, driving insights for federal research initiatives.
About the role
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL processes using Apache Spark and Hadoop ecosystems.
- Implement data models and schemas in relational and NoSQL databases to support complex analytical workloads.
- Leverage AWS services (EMR, S3, Redshift, Glue) to build and optimize cloud‑native data solutions.
- Collaborate with data scientists and business stakeholders to translate requirements into robust, production‑ready data architectures.
- Ensure data quality, governance, and security compliance across all data assets.
Requirements
- 7+ years of experience in big data engineering and data architecture.
- Proficiency in Spark, Hadoop, and related ecosystem tools (Hive, Pig, Flink).
- Strong SQL skills and experience with both relational and NoSQL databases.
- Hands‑on experience with AWS data services (EMR, S3, Redshift, Glue).
- Excellent problem‑solving skills and ability to work in a fast‑paced, collaborative environment.
Skills
apache sparkhadoopsqlpythonaws