onsite
Data Engineer
Data Engineer
This role involves designing, developing, and optimizing scalable ETL/ELT pipelines for enterprise data platforms. The engineer will build and maintain robust data solutions using Snowflake, Python, and AWS services, while also developing advanced SQL queries and data transformation workflows using dbt.
About the role
Responsibilities
- Design, develop, and optimize scalable ETL/ELT pipelines for enterprise data platforms
- Build and maintain robust data solutions using Snowflake, Python, and AWS services
- Develop advanced SQL queries using CTEs, window functions, query tuning, and performance optimization techniques
- Work with Snowflake warehouses, tasks, streams, and data pipelines for efficient data processing
- Create and maintain data transformation workflows using dbt (data build tool)
- Develop reporting datasets and support dashboarding solutions using Amazon QuickSight
- Perform data validation, data integrity checks, and root cause analysis to ensure data accuracy and reliability
- Integrate and manage data across platforms including DynamoDB, S3, AWS Glue, Lambda, and Rockset
- Collaborate with cross-functional teams including analytics, product, and clinical stakeholders to support reporting requirements
- Monitor pipeline performance and troubleshoot production data issues
Skills
ETL/ELT pipelinesSnowflakePythonAws ServicesSQLCTEswindow functionsquery tuningPerformance OptimizationSnowflake warehousesSnowflake tasksSnowflake streamsData Pipelinesdbt (data build tool)Amazon QuickSightData Validationdata integrity checksRoot Cause AnalysisDynamodbS3Aws Glue