The Data Engineer will play a lead role in acquiring, transforming, and integrating data from enterprise systems into scalable data platforms. The role involves designing high-performance data solutions, mentoring junior engineers,and collaborating across different functions to ensure strategic data initiatives are delivered efficiently and effectively. This individual will have a strong track record in architecting and building robust Data Warehouses using Microsoft SQL Server and Azure technologies.
Strong expertise in healthcare data domains is highly preferred.
NOTE: THIS IS A HYBRID ROLE. MUST BE WILLING TO COMMUTE TO THE ADDISON, TX. OFFICE 3 DAYS PER WEEK!
PRIMARY DUTIES
- Lead the integration of data from Clinical/Healthcare Practice Management Systems, Electronic Medical Record
- Architect and oversee the development of scalable data platforms and database architectures supporting
- Design and optimize complex ETL/ELT data pipelines using Azure Data Factory, other Azure services and python,
- Orchestrate pipelines that leverage AI/LLMs for data extraction from various documents and sources.
- Drive initiatives to capture all necessary data and orchestrate the development of sustainable enterprise-grade
- Conduct advanced data profiling, cleansing, and transformation for analytics and reporting teams.
- Drive implementation of Master Data Management (MDM) strategies to ensure data consistency and integrity.
- Identify process improvement opportunities and spearhead automation to reduce delivery time and increase
- Establish and maintain comprehensive data lineage, monitoring, and operational tracking systems.
- Provide hands-on support while mentoring junior engineers and contributing to a culture of knowledge sharing
- Collaborate closely with stakeholders to gather evolving data requirements and translate them into scalable
- Maintain high standards for code quality through documentation, source control, code reviews, and rigorous
- Identify integration gaps, recommend solutions, and ensure continuous improvement of data processes.
- Establish and enforce best practices for data engineering and integration across the team.
- Explore and evaluate emerging Azure features, leading proofs of concept to assess fit for purpose.
MINIMUM QUALIFICATIONS AND REQUIREMENTS
- 7+ years of experience in database and ETL development roles.
- 4+ years of deep hands-on experience with Azure Data Factory (ADF).
- 3+ years of experience with healthcare and/or financial data or other highly regulated vertical segments.
- 2+ years of experience using python
- Strong working knowledge of Azure ecosystem tools.
- Advanced proficiency in T-SQL and SQL Server.
- Strong grasp of data modeling, indexing, and schema design principles.