Lead Data Engineer - GCP Dataflow Java BigQuery - Rytsense Technologies
Data Engineer
Lead Data Engineer focused on designing and optimizing scalable GCP data pipelines with Apache Beam/Dataflow, Java, and BigQuery for enterprise analytics.
About the role
Key Responsibilities
Design, develop, and maintain scalable ETL/ELT pipelines using GCP services such as Cloud Storage, Pub/Sub, and Dataflow.
Build real‑time and batch data processing workflows with Apache Beam, ensuring high throughput and low latency.
Implement robust backend processing components in Java, integrating with GCP services and third‑party APIs.
Optimize BigQuery data models, queries, and storage for performance and cost efficiency.
Collaborate with data scientists, analysts, and product teams to translate business requirements into technical solutions.
Monitor pipeline health, troubleshoot issues, and implement automated alerting and logging.
Requirements
5+ years of experience as a Data Engineer or similar role.
Deep expertise in Google Cloud Platform, including Dataflow, Pub/Sub, Cloud Storage, and BigQuery.
Strong programming skills in Java and experience with Apache Beam SDK.
Proven track record of designing and deploying production‑grade data pipelines.
Excellent problem‑solving skills and ability to work independently in a fast‑paced environment.