remote
Senior Software Engineer - Data Platform - Coinbase
Software Engineer
Lead the design and implementation of large‑scale data pipelines and analytics services using Python, Scala, and Spark on AWS, driving performance, reliability, and scalability for a global financial platform.
About the role
Key Responsibilities
- Architect, develop, and maintain high‑throughput data pipelines that ingest, transform, and serve millions of events per day.
- Collaborate with data scientists and product teams to expose clean, versioned datasets for analytics and machine‑learning workloads.
- Optimize Spark jobs and SQL queries for cost, latency, and resource utilization across a distributed cluster.
- Implement CI/CD, monitoring, and alerting for data services using Kubernetes, Helm, and Prometheus.
- Mentor junior engineers, conduct code reviews, and champion best practices in data engineering.
Requirements
- 5+ years of production software engineering experience, with 3+ years focused on data platforms.
- Proficiency in Python and Scala, and hands‑on experience with Apache Spark.
- Deep knowledge of AWS services (EMR, Redshift, S3, Glue, Athena) and data lake architecture.
- Strong SQL skills and experience with distributed query engines.
- Experience deploying and managing services on Kubernetes in a cloud environment.
Skills
pythonscalaapache sparkawssqlkubernetes