onsite
Expert Data Engineer - AI Data
Expert Data Engineer - AI Data
As an Expert Data Engineer - AI Data, you will be responsible for designing, building, and maintaining robust data pipelines and ETL/ELT workflows. You will collaborate closely with algorithm engineers and data scientists to operationalize ML features and ensure data quality, performance, and compliance.
About the role
Job Description
- Design, build, and maintain data pipelines that support algorithm development and large‑scale analytics.
- Develop ETL/ELT workflows, ensuring data accuracy, quality, and timeliness.
- Work closely with algorithm engineers and data scientists to operationalise ML features and support model training/inference.
- Optimise data processes for performance, cost efficiency, and reliability.
- Manage and maintain data warehouses, feature stores, and streaming systems.
- Implement monitoring, alerting, and observability for critical data flows.
- Participate in schema design, data modeling, and documentation.
- Ensure compliance with data governance, privacy, and security standards.
Requirements
- Bachelor’s degree or above in Computer Science, Software Engineering or a related field
- Minimum 4 years of full time working experience with one or more big data technologies such as Spark or Flink
- Experience with feature algorithm experimentation or training
- Proficient in one or more programming languages, such as Python, Java, Scala, or SQL.
- Experience in data architecture design, data warehouse modeling, or performance tuning
- Strong logical thinking, communication skills, and project coordination abilities
Skills
SparkFlinkPythonJavaScalaSQLEtlELTData WarehousingData ModelingData Pipelinesfeature storesstreaming systems