onsite
Lead AI and Data Solutions Engineer II
Software Engineer
Lead the design and implementation of AI-driven data pipelines on AWS, leveraging Apache Spark, Python, and REST APIs to deliver scalable, production‑grade solutions.
About the role
Key Responsibilities
- Architect and build end‑to‑end AI and data processing solutions on the AWS cloud platform.
- Design, develop, and optimize Apache Spark applications for large‑scale data transformation and analytics.
- Create and maintain robust RESTful APIs to expose data services and model inference endpoints.
- Collaborate with data scientists and product teams to integrate machine‑learning models into production pipelines.
- Implement best practices for security, reliability, and performance monitoring in cloud environments.
Requirements
- 5+ years of experience developing data pipelines and AI solutions on AWS.
- Strong proficiency in Python and Spark (PySpark or Scala).
- Hands‑on experience building and consuming REST APIs.
- Solid understanding of data engineering concepts, including ETL, streaming, and data warehousing.
- Demonstrated ability to lead technical projects and mentor junior engineers.
Skills
awsapache sparkpythonmachine learning