onsite
Senior Software Engineer Generative AI - Freddie Mac
AI Engineer
Senior Software Engineer driving generative AI initiatives, building LLM‑powered services and agentic systems on cloud platforms, with a focus on Python, AWS, and container orchestration.
About the role
Key Responsibilities
- Design, develop, and deploy generative AI solutions leveraging large language models for multifamily business workflows.
- Build scalable, cloud‑native services using AWS, Kubernetes, and Docker, ensuring high availability and performance.
- Implement CI/CD pipelines and automated testing to accelerate delivery and maintain code quality.
- Collaborate with data scientists and product owners to create prompt engineering strategies and fine‑tune models for specific use cases.
- Monitor, troubleshoot, and optimize AI services in production, applying best practices for security and cost efficiency.
Requirements
- 5+ years of professional software engineering experience, with strong proficiency in Python.
- Hands‑on experience developing, deploying, and scaling LLM‑based applications.
- Deep knowledge of AWS services (e.g., SageMaker, Lambda, ECS/EKS) and container orchestration with Kubernetes.
- Proven ability to build CI/CD pipelines and work with Docker, Helm, or similar tooling.
- Experience in prompt engineering, model fine‑tuning, and integrating AI APIs into production systems.
Skills
pythonawskubernetesdockercicd