onsite
Senior Data Engineer, Network Intelligence - Xplore Inc.
Data Engineer
Senior Data Engineer driving end‑to‑end data pipelines for network analytics and AI across fibre, 5G, and satellite platforms, leveraging Python, Spark, SQL, and AWS to deliver scalable, cloud‑and‑on‑prem solutions.
About the role
Key Responsibilities
- Design, build, and maintain robust data pipelines that ingest, transform, and store network telemetry from fibre, fixed wireless, and satellite sources.
- Implement scalable ETL workflows using Python and Apache Spark, ensuring high data quality and performance across cloud and on‑prem environments.
- Develop and optimize data lake architecture on AWS, including S3, Glue, and Redshift, to support real‑time analytics and AI workloads.
- Collaborate with data scientists and network engineers to create data models that enable observability, predictive maintenance, and AI‑driven network optimization.
- Monitor pipeline health, troubleshoot issues, and continuously improve reliability, latency, and cost efficiency.
Requirements
- 5+ years of experience in data engineering, with a strong focus on large‑scale data pipelines.
Skills
pythonapache sparksqlaws