remote
Senior Data Engineer - Samsara
Data Engineer
Senior Data Engineer responsible for designing, building, and scaling data pipelines on AWS, leveraging Python, Spark, and Kafka to deliver real‑time analytics for IoT operations.
About the role
Key Responsibilities
- Design, develop, and maintain scalable data pipelines that ingest, process, and store high‑volume IoT telemetry.
- Implement real‑time streaming solutions using Kafka and batch processing with Apache Spark.
- Build and optimize data models and warehouses on AWS services such as Redshift, S3, and Glue.
- Automate workflow orchestration and monitoring with Apache Airflow.
- Collaborate with data scientists, product managers, and engineering teams to translate business requirements into robust data solutions.
Requirements
- 5+ years of professional experience in data engineering or related fields.
- Strong proficiency in Python and SQL, with hands‑on experience building ETL pipelines.
- Deep knowledge of AWS ecosystem (EC2, S3, Redshift, Lambda, Glue) and infrastructure‑as‑code practices.
- Experience with streaming platforms (Kafka) and distributed processing frameworks (Spark).
- Familiarity with workflow orchestration tools such as Airflow and best practices for data quality, monitoring, and security.
Skills
pythonsqlapache sparkawskafkaairflow