onsite
Gen AI Consultant
Software Engineer
Lead AI solution design and deployment, leveraging AWS SageMaker, Azure Machine Learning, and big‑data tools like Apache Airflow and Spark, while ensuring robust CI/CD pipelines and Python-based automation.
About the role
Key Responsibilities
- Architect and implement end‑to‑end generative AI pipelines using AWS SageMaker and Azure Machine Learning services.
- Design and orchestrate data workflows with Apache Airflow, ensuring scalability and reliability.
- Develop and optimize Spark jobs for large‑scale data processing and model training.
- Build and maintain CI/CD pipelines for model versioning, testing, and deployment.
- Collaborate with data scientists and stakeholders to translate business requirements into technical solutions.
Requirements
- Proven experience with AWS SageMaker, Azure Machine Learning, Apache Airflow, and Apache Spark.
- Strong scripting skills in Python and familiarity with ML frameworks.
- Hands‑on knowledge of CI/CD tools (e.g., GitHub Actions, Jenkins, Azure DevOps).
- Excellent problem‑solving abilities and a passion for emerging AI technologies.
Skills
apache sparkcicdpython