onsite
Senior Data Engineer - Geosyntec Consultants, Inc.
Data Engineer
Senior Data Engineer responsible for designing, building, and optimizing large‑scale data pipelines and warehouses using Python, SQL, AWS, and Airflow to support critical DOE mission data analytics.
About the role
Key Responsibilities
- Design, develop, and maintain robust ETL pipelines to ingest, transform, and load data from diverse sources into cloud‑based data warehouses.
- Implement and manage workflow orchestration using Apache Airflow, ensuring reliable scheduling, monitoring, and error handling.
- Collaborate with scientists, analysts, and domain experts to translate complex data requirements into scalable data models and schemas.
- Optimize data storage and query performance on platforms such as Snowflake and Amazon Redshift, applying best practices for partitioning, indexing, and caching.
- Establish data governance, security, and compliance controls in line with DOE and federal regulations.
Requirements
- 5+ years of professional experience in data engineering, with strong proficiency in Python and SQL.
- Hands‑on experience building and operating data pipelines on AWS services (e.g., S3, Lambda, Glue, Redshift) and using Airflow for orchestration.
- Demonstrated ability to design dimensional and relational data models for analytical workloads.
- Familiarity with modern data warehouse solutions such as Snowflake, including performance tuning and cost optimization.
- Excellent problem‑solving skills, ability to work cross‑functionally, and a commitment to delivering high‑quality, secure data solutions.
Skills
pythonsqlawsairflowsnowflake