onsite
Data Operations Engineer - Fastmarkets
Systems Engineer
Data Operations Engineer responsible for designing, building, and maintaining robust data pipelines and warehouses, ensuring high data quality and efficient data flow across the organization using Python, SQL, ETL tools, and AWS services.
About the role
Key Responsibilities
- Design, develop, and maintain scalable data pipelines to ingest, transform, and load data from diverse sources into data warehouses.
- Implement and optimize ETL processes using Python, SQL, and cloud-based services (AWS).
- Ensure data quality through validation, monitoring, and automated testing frameworks.
- Collaborate with data scientists, analysts, and product teams to understand data requirements and deliver actionable insights.
- Document data models, pipeline architecture, and operational procedures for maintainability.
Requirements
- Proven experience in data engineering with strong Python and SQL skills.
- Hands‑on experience building ETL pipelines and managing data warehouses (Snowflake, Redshift, BigQuery).
- Familiarity with cloud platforms, especially AWS (S3, Glue, Lambda, Redshift).
- Solid understanding of data quality principles and automated testing.
- Excellent problem‑solving skills and ability to work collaboratively in a fast‑paced environment.