remote
Associate Azure Data Engineer - Techolution
Data Engineer
Associate Azure Data Engineer responsible for building and maintaining data pipelines, transforming raw data into actionable insights using PySpark, SQL, and Azure data services. Focus on data lake architecture, ETL automation, and collaboration with AI teams.
About the role
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using PySpark and Azure Data Factory.
- Implement data ingestion, transformation, and storage solutions in Azure Data Lake and Azure Databricks.
- Collaborate with data scientists and business analysts to deliver actionable insights and support AI initiatives.
- Ensure data quality, governance, and security across all data assets.
- Monitor pipeline performance, troubleshoot issues, and optimize for cost and efficiency.
Requirements
- Proficiency in PySpark, SQL, and Azure data services (Data Factory, Data Lake, Databricks).
- Strong analytical skills with a passion for data-driven decision making.
- Excellent problem‑solving abilities and a proactive, ownership mindset.
- Experience with cloud data platforms and familiarity with AI concepts is a plus.
- Self‑motivated, ambitious, and committed to high work ethics.