remote
Senior Data Engineer - Svitla Systems
Data Engineer
Senior Data Engineer responsible for designing and scaling real‑time data pipelines, event streaming, and analytics platforms using Python, Spark, Kafka and AWS services.
About the role
Key Responsibilities
- Design, develop, and maintain high‑throughput data pipelines for real‑time event streams.
- Implement data models and ETL processes using Python, SQL, and Apache Spark.
- Orchestrate workflows with Apache Airflow and ensure reliable scheduling and monitoring.
- Deploy and manage cloud infrastructure on AWS, including S3, Redshift, and Kinesis.
- Collaborate with data scientists and product teams to provide clean, model‑ready data for AI solutions.
- Establish data governance, quality checks, and performance optimization at scale.
Requirements
- 5+ years of professional experience in data engineering or related fields.
- Strong proficiency in Python, SQL, and big‑data processing frameworks such as Apache Spark.
- Hands‑on experience with event streaming platforms like Kafka or Kinesis.
- Solid understanding of AWS services and infrastructure‑as‑code concepts.
- Experience with workflow orchestration tools (e.g., Airflow) and containerization (Docker).
Skills
pythonsqlapache sparkkafkaawsairflow