onsite
Data Architect Managed Services
Software Engineer
Lead the design and implementation of scalable data solutions in a managed services environment, leveraging Apache Airflow, Apache Atlas, and advanced anomaly detection techniques to ensure data integrity and operational excellence.
About the role
Key Responsibilities
- Architect and maintain end‑to‑end data pipelines using Apache Airflow, ensuring reliability, scalability, and performance.
- Implement data governance and metadata management with Apache Atlas, enforcing compliance and data lineage.
- Design and deploy anomaly detection models to identify data quality issues and operational risks.
- Collaborate with cross‑functional teams to translate business requirements into robust data architectures.
- Optimize data workflows for cost, speed, and resource utilization in a managed services context.
Requirements
- Proven experience designing data architectures for large‑scale, cloud‑based environments.
- Hands‑on expertise with Apache Airflow and Apache Atlas.
- Strong background in anomaly detection techniques and data quality monitoring.
- Excellent problem‑solving skills and ability to work independently in a managed services setting.
Skills
software developmentsystem designproblem solving