onsite
Data Engineer - GTR
Data Engineer
Data Engineer responsible for designing, building, and maintaining robust data pipelines and models on the DataHub platform, enabling reliable reporting, analytics, and machine‑learning use cases using Python, SQL, Airflow, and Snowflake.
About the role
Key Responsibilities
- Design, develop, and maintain scalable ETL pipelines using Python and Airflow to ingest, transform, and load data into Snowflake.
- Collaborate with analysts and data scientists to translate business requirements into well‑governed data products and models.
- Implement data quality checks, monitoring, and alerting to ensure high data integrity and availability.
- Document data architecture, pipeline logic, and metadata in DataHub for auditability and reuse.
- Optimize query performance and storage costs across the data warehouse.
Requirements
- Proven experience building data pipelines with Python, SQL, and Airflow.
- Strong knowledge of Snowflake data warehousing concepts and best practices.
- Experience with data modeling, schema design, and data governance.
- Familiarity with cloud platforms (AWS, Azure, or GCP) and CI/CD for data workflows.
- Excellent problem‑solving skills and ability to work collaboratively in a fast‑paced environment.
Skills
pythonsqlairflowsnowflake