onsite
AI Architect - McKinsol Consulting Inc
Software Engineer
Lead the design and governance of an enterprise AI platform, orchestrating LLM API gateways, GPU compute pools, sandbox provisioning, and model registry while enforcing security, token metering, and audit compliance.
About the role
Key Responsibilities
- Architect and govern the end‑to‑end AI platform, including LLM API gateway, GPU and compute allocation pools, sandbox provisioning, and model registry.
- Define infrastructure standards, API gateway patterns, and reference architectures for all AI delivery towers and partner integrations.
- Implement security gate automation, token metering, rate limiting, audit logging, and DLP validation to protect data and ensure compliance.
- Collaborate with cross‑functional teams to translate business requirements into scalable, secure AI solutions.
- Continuously evaluate emerging AI technologies and recommend platform enhancements.
Requirements
- Proven experience designing large‑scale AI platforms with LLMs and GPU compute.
- Strong knowledge of API gateway design, security best practices, and governance frameworks.
- Hands‑on experience with model registry, sandbox provisioning, and automated security controls.
- Excellent communication skills and ability to influence stakeholders across technical and business domains.