remoteonsite
Data Engineer, Global Affairs
Data Engineer
Design and operate scalable data pipelines on a cloud‑based AI platform, leveraging C++ and big‑data technologies to deliver reliable, high‑performance data solutions for global operations.
About the role
Key Responsibilities
- Architect, develop, and maintain robust data pipelines that ingest, transform, and store massive datasets in a cloud environment.
- Implement high‑performance C++ components for data processing, ensuring low latency and high throughput.
- Integrate artificial intelligence models into the data workflow, enabling real‑time analytics and decision support.
- Collaborate with cross‑functional teams to define data requirements, optimize storage solutions, and ensure data quality and governance.
- Monitor pipeline performance, troubleshoot issues, and continuously improve reliability and scalability.
Requirements
- Strong proficiency in C++ with experience building data‑intensive applications.
- Hands‑on experience with cloud platforms (e.g., AWS, Azure, GCP) and container orchestration.
- Deep understanding of big‑data technologies such as Hadoop, Spark, or Flink.
- Proven ability to design and implement end‑to‑end data pipelines and ETL processes.
- Familiarity with AI/ML model integration and deployment in production environments.