onsite

Senior GenAI Platform Engineer / Senior LLM Infrastructure Engineer (On-Prem AI Platform)

AsceticVoyage is looking for a Senior GenAI Platform Engineer / Senior LLM Infrastructure Engineer to focus on on-premise AI platforms. This role requires extensive experience with both cloud and on-premises technologies related to AI/ML infrastructure, including GPU orchestration, inference optimization, and MLOps/LLMOps.

About the role

About the Role

AsceticVoyage is seeking a Senior GenAI Platform Engineer / Senior LLM Infrastructure Engineer with expertise in On-Prem AI Platforms to join our team in Charlotte, NC.

Requirements

Cloud Requirements

Arize AI
Claude Cowork
GCP
Terraform
Azure
Cloud Networking
Landing Zones
Org Policy / Governance
HashiCorp Vault
Hybrid Connectivity
Kubernetes
GKE
OpenShift (OCP)
Platform Engineering
Observability
SRE / SLOs
Python
Internal Developer Portals
GenAI Platforms
LLMs
RAG
MLOps/LLMOps

On-premises Requirements

vLLM
TensorRT‑LLM
Triton Inference Server
SGLang
Inference Optimization
Continuous Batching
Speculative Decoding
KV Cache / Prefix Caching
FP8 / AWQ / GPTQ
Tensor Parallelism
Kubernetes ML Serving
KServe
OpenShift AI
Helm / Operators
GPU Orchestration
Run:AI
Performance Benchmarking
CUDA / NCCL / MIG
Prometheus / Grafana
ML Observability
GuideLLM
Locust
Arize AI
Claude Cowork

Skills

Arize AIClaude CoworkGCPTerraformAzureCloud NetworkingLanding ZonesOrg Policy / GovernanceHashiCorp VaultHybrid ConnectivityKubernetesGKEOpenShift (OCP)Platform EngineeringObservabilitySRE / SLOsPythonInternal Developer PortalsGenAI PlatformsLlmsRagMLOps/LLMOps

CompanyAsceticVoyage

DepartmentEngineering

LocationCharlotte, United States

Experience5+ years

Tenurecontractual

LevelSenior

Posted June 7, 2026