onsite
Lead Data Engineer - Enfycon INC
Data Engineer
Lead Data Engineer responsible for designing, building, and optimizing scalable GCP-based data pipelines, leveraging Apache Beam, Dataflow, and BigQuery to deliver real‑time and batch processing solutions for enterprise applications.
About the role
Key Responsibilities
- Design and develop scalable ETL/ELT pipelines using Google Cloud Platform services.
- Build and maintain real‑time and batch data processing pipelines with Apache Beam and Dataflow.
- Develop robust backend processing solutions in Java, ensuring performance and reliability.
- Integrate and optimize data flows into BigQuery, managing schemas, partitioning, and query performance.
- Collaborate with data scientists and product teams to translate business requirements into technical solutions.
- Implement monitoring, logging, and alerting for data pipelines to ensure high availability.
Requirements
- 7+ years of experience in data engineering and cloud data platform development.
- Deep expertise in Google Cloud Platform, including BigQuery, Dataflow, Pub/Sub, and Cloud Storage.
- Proficient in Java and experience with Apache Beam programming model.
- Strong understanding of ETL/ELT concepts, data modeling, and performance tuning.
- Excellent problem‑solving skills and ability to work in a fast‑paced, collaborative environment.