onsite
Data Engineer - Databricks, Power BI & AI/ML - Argyllinfotech
Data Engineer
Seeking a Data Engineer to build and optimize data pipelines on Databricks, create Power BI dashboards, and enable AI/ML solutions within a new Data Center of Excellence.
About the role
Key Responsibilities
- Design, develop, and maintain scalable ETL pipelines using Databricks and Azure services.
- Collaborate with data scientists to operationalize machine‑learning models and support AI/ML initiatives.
- Create interactive Power BI reports and dashboards that translate complex data into actionable insights.
- Implement data‑warehouse architectures, ensuring data quality, governance, and performance.
- Optimize SQL queries and data models for high‑volume, low‑latency analytics.
- Participate in the Data Center of Excellence, establishing best practices and standards for enterprise analytics.
Requirements
- 3+ years of hands‑on experience with Databricks, Azure Data Factory, and related cloud data platforms.
- Proficiency in Python and SQL for data transformation and analysis.
- Strong background in building Power BI visualizations and data models.
- Experience deploying and supporting machine‑learning models in production.
- Solid understanding of data‑warehouse concepts, ETL processes, and performance tuning.
Skills
databrickspower bipythonsqlazuremachine learning