onsite
Azure Data Engineer - TEKsystems c/o Allegis Group
Data Engineer
Design and optimize enterprise data pipelines on Azure, modernizing Oracle EBS data into scalable, near‑real‑time datasets using Azure Data Factory, Synapse, and advanced SQL/Python techniques.
About the role
Key Responsibilities
- Design, develop, and maintain end‑to‑end data pipelines that ingest, transform, and load data from Oracle EBS and other source systems into Azure platforms.
- Implement incremental load and UPSERT patterns to enable near real‑time data availability for analytics and reporting.
- Build and optimize data models in Azure Synapse Analytics, ensuring high performance and scalability.
- Write complex SQL queries and stored procedures for data cleansing, enrichment, and validation.
- Collaborate with data architects, business analysts, and stakeholders to translate business requirements into technical solutions.
- Monitor pipeline health, troubleshoot issues, and continuously improve data processing efficiency.
Requirements
- Strong experience with Azure Data Factory and Azure Synapse Analytics.
- Expertise in SQL development, performance tuning, and data modeling.
- Hands‑on experience integrating Oracle EBS data into Azure environments.
- Proficiency in Python or similar scripting language for data manipulation.
- Solid understanding of data warehousing concepts, incremental loading, and UPSERT techniques.