onsite
Principal Software Engineer - Data Engineering & Streaming Primitives - Snowflake
Software Engineer
Lead the design and implementation of high‑performance data pipelines and streaming primitives, driving innovation in real‑time analytics and data lake architecture using Python, Java, Spark, Kafka, and cloud services.
About the role
Key Responsibilities
- Architect and build scalable, fault‑tolerant streaming pipelines that ingest, process, and expose data in real time.
- Collaborate with cross‑functional teams to define data models, schema evolution, and performance benchmarks.
- Implement and optimize Spark jobs and Kafka consumers/producers for low latency and high throughput.
- Design and maintain data quality, monitoring, and alerting frameworks across the streaming stack.
- Mentor junior engineers and champion best practices in code quality, testing, and CI/CD.
Requirements
- 10+ years of software engineering experience with a focus on data engineering and streaming.
- Proficiency in Python, Java, and distributed processing frameworks (Spark, Flink).
- Deep knowledge of Kafka, Kinesis, or similar streaming platforms.
- Strong SQL skills and experience with cloud data services (AWS, GCP, or Azure).
- Excellent problem‑solving skills, a passion for experimentation, and a collaborative mindset.
Skills
pythonjavaapache sparksqlaws