onsite
Data Engineer - Elliptic
Data Engineer
Data Engineer building scalable blockchain data pipelines using Python, Spark, Kafka, and AWS to transform raw on‑chain and off‑chain data into actionable insights for financial institutions.
About the role
Key Responsibilities
- Design, develop, and maintain high‑throughput data pipelines ingesting blockchain and off‑chain data streams.
- Implement ETL processes using Python, Spark, and SQL to cleanse, enrich, and store data in scalable data warehouses on AWS.
- Collaborate with data scientists and product teams to define data models and ensure data quality for analytics and decisioning services.
- Optimize pipeline performance, monitor job health, and troubleshoot production issues.
- Document architecture, data flows, and best practices for future scalability.
Requirements
- 3+ years of experience in data engineering, preferably in fintech or blockchain domains.
- Experience designing data models and building ETL pipelines for large‑scale analytics.
- Excellent problem‑solving skills and ability to work in a fast‑paced, collaborative environment.
Skills
pythonsqlapache sparkaws