remote
Software Engineer IV, Data - ACV Auctions
Software Engineer
Senior Software Engineer focused on building scalable data pipelines and ML models using Python, SQL, AWS, and Spark to power automotive marketplace insights.
About the role
Key Responsibilities
- Design, develop, and maintain large-scale data pipelines that ingest, transform, and store automotive transaction data.
- Implement and optimize Spark jobs for batch and streaming processing, ensuring high performance and reliability.
- Build and deploy machine learning models to generate pricing, demand, and fraud detection insights.
- Collaborate with data scientists, product managers, and infrastructure teams to translate business requirements into technical solutions.
- Automate deployment and monitoring using Docker, Kubernetes, and AWS services (S3, Redshift, EMR, Lambda).
- Continuously improve data quality, documentation, and testing practices.
Requirements
- 8+ years of software engineering experience with a focus on data engineering.
- Proficiency in Python, SQL, and Apache Spark for large‑scale data processing.
- Hands‑on experience with AWS data services (S3, Redshift, EMR, Glue, Lambda).
- Strong background in building and deploying machine learning models.
- Excellent problem‑solving skills and a passion for clean, maintainable code.
Skills
pythonsqlawsmachine learningapache sparkdocker