remote
IT Data Engineer III
Data Engineer
Senior data engineer focused on designing, deploying, and maintaining Azure-based data pipelines, leveraging ARM templates and ANSI X12 standards to ensure robust, scalable data integration solutions.
About the role
Key Responsibilities
- Design, develop, and maintain Azure Data Factory pipelines for large-scale data ingestion and transformation.
- Implement and manage Azure Data Lake storage solutions, ensuring data security and compliance.
- Automate infrastructure deployment using ARM templates, ensuring repeatable and version-controlled environments.
- Integrate ANSI X12 EDI data streams into Azure data workflows, handling mapping, validation, and error handling.
- Collaborate with data scientists and business analysts to optimize data models and performance.
Requirements
- 5+ years of experience in data engineering with a strong focus on Azure services.
- Hands‑on experience with ANSI X12 EDI standards and data integration.
- Strong scripting skills in PowerShell or Python for automation and data processing.
- Excellent problem‑solving skills and ability to work in a fast‑paced environment.
Skills
apache sparksqlairflow