remoteonsite
Data Engineer - ETL - Delphic Global
Data Engineer
Senior Data Engineer with 7–8 years of experience building scalable ETL/ELT pipelines on Azure Databricks and Snowflake, leveraging PySpark, Python, and infrastructure automation. Strong background in AI/ML and large language models enhances data solutions.
About the role
Key Responsibilities
- Design, develop, and maintain end‑to‑end ETL/ELT pipelines using Azure Databricks, Snowflake, and PySpark.
- Optimize data workflows for performance, cost, and reliability across cloud environments.
- Implement infrastructure automation (IaC) to provision and manage data platforms.
- Collaborate with data scientists to integrate AI/ML and LLM workflows into production pipelines.
- Ensure data quality, governance, and security compliance throughout the data lifecycle.
Requirements
- 7–8 years of professional experience in data engineering and ETL development.
- Hands‑on knowledge of AI/ML concepts and large language models.
- Strong analytical, problem‑solving, and communication skills.