remote
Data Engineer - delphic
Data Engineer
Senior Data Engineer responsible for building and optimizing data pipelines across Snowflake and Azure services, leveraging Python, PySpark, and SQL to deliver scalable, high‑performance data solutions and insightful PowerBI dashboards.
About the role
Key Responsibilities
- Design, develop, and maintain end‑to‑end data pipelines using Snowflake, Azure Data Factory, and Azure Databricks.
- Implement dimensional modeling and data warehousing best practices to support analytics and reporting.
- Write efficient Python and PySpark code for data transformation, enrichment, and quality checks.
- Integrate streaming data with Kafka and store results in Azure SQL Database and Azure Data Lake Storage.
- Collaborate with data scientists and business analysts to deliver PowerBI dashboards and PowerApps solutions.
- Automate deployment and monitoring via CI/CD pipelines in GitHub Actions.
Requirements
- 5+ years of experience in data engineering and data modeling.
- Proficiency in Snowflake, Azure Data Factory, Azure Databricks, and Azure Synapse.
- Strong programming skills in Python, PySpark, and SQL.
- Experience with Kafka, MongoDB, and PowerBI.
- Excellent problem‑solving skills and ability to work independently in a remote environment.
Skills
snowflakepythonsqlkafka