onsite
Senior Data Engineer - Netbuilder
Data Engineer
Senior Data Engineer leading end‑to‑end telemetry pipelines, architecting observability platforms on AWS, and driving data quality with Python, SQL, Airflow, Kafka, and Spark.
About the role
Key Responsibilities
- Design, build, and maintain scalable telemetry pipelines that ingest, transform, and store observability data across multiple client environments.
- Implement data ingestion using Kafka, stream processing with Spark, and batch workflows orchestrated by Airflow.
- Develop and optimize SQL queries and data models to support real‑time dashboards and alerting systems.
- Deploy and operate observability platforms on AWS (ECS/EKS, S3, Redshift, Athena) ensuring high availability and performance.
- Collaborate with cross‑functional teams to define data quality standards, monitoring, and incident response procedures.
Requirements
- 5+ years of experience as a data engineer in enterprise environments.
- Hands‑on experience building observability or telemetry pipelines.
- Excellent problem‑solving skills and ability to work independently in a delivery‑focused role.
Skills
pythonsqlairflowkafkaaws