remoteonsite
Senior Software Engineer-Data Engineer - Azure- GenAI - CGI
AI Engineer
Senior Software Engineer – Data Engineer focused on Azure and Generative AI, building scalable data pipelines, modeling, and AI solutions to power intelligent insights and automation.
About the role
Key Responsibilities
- Design, develop, and maintain large‑scale data pipelines on Azure Data Factory, Synapse, and Databricks to ingest, transform, and store structured and unstructured data.
- Implement GenAI solutions using Azure OpenAI Service, fine‑tuning models and integrating them into data workflows for natural language processing and automated content generation.
- Collaborate with data scientists and product teams to translate business requirements into robust data models, ensuring performance, security, and compliance.
- Optimize query performance and resource utilization across SQL, Spark, and Delta Lake environments, applying best practices for cost management.
- Document architecture, data lineage, and operational procedures; mentor junior engineers on Azure, Spark, and AI best practices.
Requirements
- 5+ years of experience in data engineering with a strong focus on Azure services.
- Proficiency in Python, SQL, and Apache Spark for data processing and analytics.
- Hands‑on experience with Azure OpenAI Service, Azure Machine Learning, and related GenAI tooling.
- Solid understanding of data governance, security, and compliance standards.
- Excellent communication skills and a collaborative mindset.
Skills
azurepythonsqlapache spark