remote
Staff Data Engineer, Virtual Expert Platform - Intuit
Data Engineer
Lead the design and implementation of scalable data pipelines for a virtual expert platform, leveraging Python, Spark, and AWS to deliver high‑performance analytics and data services.
About the role
Key Responsibilities
- Architect, develop, and maintain large‑scale data pipelines that ingest, transform, and serve data for the Virtual Expert Platform.
- Collaborate with cross‑functional teams to define data models, quality standards, and performance benchmarks.
- Optimize data processing workflows using Spark, Python, and SQL to achieve low latency and high throughput.
- Implement robust monitoring, alerting, and troubleshooting processes to ensure data reliability and availability.
- Drive continuous improvement of data infrastructure, adopting new cloud services and best practices.
Requirements
- 10+ years of experience in data engineering, with a strong focus on cloud‑native architectures.
- Proficiency in Python, Spark, and SQL for data transformation and analytics.
- Hands‑on experience with AWS services such as S3, Redshift, Glue, and EMR.
- Deep understanding of data modeling, ETL design, and performance tuning.
- Excellent communication skills and a proven ability to mentor junior engineers.