remote
Data Engineer - Brown & Brown Insurance
Data Engineer
Data Engineer responsible for designing, building, and optimizing scalable healthcare data pipelines on Microsoft Azure, focusing on Azure Synapse Analytics, data ingestion, transformation, and delivery of claims and clinical datasets.
About the role
Key Responsibilities
- Design, develop, and maintain end‑to‑end data pipelines that ingest, cleanse, and transform large‑scale healthcare datasets (claims, eligibility, provider, clinical).
- Implement and optimize data models and warehousing solutions within Azure Synapse Analytics, ensuring high performance and reliability.
- Leverage Azure Data Factory, Azure Databricks, and Apache Spark for orchestration, batch processing, and real‑time data flows.
- Write efficient SQL and Python scripts for data manipulation, validation, and enrichment.
- Collaborate with data scientists, analysts, and business stakeholders to deliver data products that support analytics and reporting needs.
- Monitor pipeline health, troubleshoot issues, and apply best practices for security, governance, and cost management in Azure.
Requirements
- Bachelor’s degree in Computer Science, Engineering, or related field with 3+ years of hands‑on data engineering experience.
- Proficiency in Azure Synapse Analytics, Azure Data Factory, and related Azure services.
- Strong SQL skills and experience writing Python code for data processing.
- Experience with Apache Spark or Databricks for large‑scale data transformations.
- Understanding of healthcare data standards (e.g., HL7, FHIR, HIPAA) and ability to work with complex medical and pharmacy data.
Skills
sqlpythonapache spark