onsite
Senior Data Platform Engineer - texicare
Data Engineer
Senior Data Platform Engineer responsible for designing, building, and scaling data pipelines and platforms using Python, Spark, Airflow, and AWS to enable real‑time analytics and robust data models for healthcare solutions.
About the role
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL processes using Python, Apache Spark, and Apache Airflow.
- Architect and implement data storage solutions on AWS (S3, Redshift, RDS) ensuring high availability and performance.
- Build real‑time data streaming integrations with Kafka to support low‑latency analytics.
- Collaborate with data scientists and product teams to create robust data models and schemas that meet business requirements.
- Implement data governance, security, and quality standards across the platform.
Requirements
- 5+ years of experience engineering data platforms in cloud environments, preferably AWS.
- Strong proficiency in Python and SQL, with hands‑on experience in Apache Spark and Airflow.
- Experience designing and managing data warehouses or data lakes, including schema design and performance tuning.
- Familiarity with streaming technologies such as Kafka and event‑driven architectures.
- Solid understanding of data security, compliance, and best practices in healthcare data handling.
Skills
pythonsqlapache sparkawskafka