onsite
Senior Data Engineer - Elliptic
Data Engineer
Senior Data Engineer responsible for designing, building, and scaling data pipelines and analytics platforms using Python, Spark, Kafka, and AWS to support blockchain intelligence products.
About the role
Key Responsibilities
- Design, develop, and maintain high‑performance data pipelines that ingest, transform, and store large‑scale blockchain data.
- Implement real‑time streaming solutions with Kafka and batch processing with Apache Spark.
- Collaborate with product and analytics teams to define data models, schemas, and APIs that enable advanced intelligence features.
- Optimize data storage and query performance on cloud platforms (AWS) and ensure reliability, scalability, and security.
- Mentor junior engineers, conduct code reviews, and champion best practices for data engineering and DevOps.
Requirements
- 5+ years of professional experience building data pipelines and analytics platforms.
- Strong proficiency in Python, SQL, and distributed processing frameworks such as Apache Spark.
- Hands‑on experience with streaming technologies (Kafka) and cloud services (AWS, S3, Redshift, EMR).
- Deep understanding of data modeling, ETL design, and performance tuning for large datasets.
- Proven ability to work autonomously, solve complex problems, and communicate technical concepts to cross‑functional teams.
Skills
pythonsqlapache sparkkafkaaws