onsite
Senior Quantitative Data Engineer - Qode Advisors Llp
Data Engineer
Lead the design and maintenance of high‑performance data pipelines for automated trading, ensuring data quality, scalability, and reliability across large financial datasets using Python, Airflow, Kafka, and AWS.
About the role
Key Responsibilities
- Design, build, and maintain robust data pipelines that feed live trading systems with high‑quality market and research data.
- Automate data workflows using Apache Airflow, ensuring timely execution and fault tolerance.
- Integrate streaming data from Kafka and batch sources, optimizing ingestion and storage on AWS services.
- Collaborate with researchers, traders, and execution teams to translate analytical requirements into scalable engineering solutions.
- Diagnose and resolve production issues, implement monitoring, and drive continuous improvement of system reliability and performance.
Requirements
- 5+ years of experience in data engineering within a quantitative or trading environment.
- Strong proficiency in Python, SQL, and experience with Airflow, Kafka, and Docker.
- Hands‑on experience with AWS services (S3, Redshift, EMR, Lambda) and large‑scale data processing.
- Excellent problem‑solving skills and ability to work independently on end‑to‑end systems.
- Effective communication skills to collaborate with cross‑functional teams.
Skills
pythonsqlkafkaawsdocker