remote
Lead Data Engineer - Python & GCP - Technology Next
Data Engineer
Lead Data Engineer with 10+ years of experience driving end‑to‑end data platform delivery on GCP, building scalable ETL/ELT pipelines, real‑time processing, and cloud‑native architectures using Python and advanced solution design.
About the role
Key Responsibilities
- Lead the design, development, and deployment of enterprise‑scale data pipelines on Google Cloud Platform.
- Architect and implement ETL/ELT workflows, real‑time streaming solutions, and data lakehouse environments using Python and GCP services such as BigQuery, Dataflow, and Pub/Sub.
- Collaborate with cross‑functional teams and customers to elicit requirements, translate business needs into technical specifications, and deliver robust, scalable data solutions.
- Mentor and coach junior engineers, establishing best practices for coding, testing, and documentation.
- Ensure data quality, security, and compliance across all data assets, implementing monitoring, alerting, and governance frameworks.
Requirements
- 10+ years of professional experience in data engineering and solution architecture.
- Deep expertise in Python, GCP, and modern data platform components.
- Proven track record building scalable ETL/ELT pipelines and real‑time data processing systems.
- Strong leadership skills with experience guiding technical teams and engaging customers.
- Excellent communication, problem‑solving, and documentation abilities.