remote
Senior Data Engineer - NinjaTrader
Data Engineer
Senior Data Engineer building scalable data pipelines and analytics solutions on AWS, leveraging Python, SQL, and Spark to transform raw market data into actionable insights for a leading trading platform.
About the role
Key Responsibilities
- Design, develop, and maintain large-scale data pipelines ingesting real‑time and historical market data.
- Implement ETL processes using Python, SQL, and Apache Spark on AWS services (S3, Redshift, Glue).
- Model data for high‑performance analytics, ensuring data quality, consistency, and compliance.
- Collaborate with data scientists and product teams to deliver data products and dashboards.
- Optimize pipeline performance, monitor job health, and troubleshoot production issues.
Requirements
- 5+ years of experience in data engineering, preferably in finance or trading.
- Proficiency in Python, SQL, and Spark for large‑scale data processing.
- Hands‑on experience with AWS data services (S3, Redshift, Glue, Lambda).
- Strong understanding of data modeling, schema design, and ETL best practices.
- Excellent problem‑solving skills and ability to work in a fast‑paced environment.
Skills
pythonsqlawsapache spark