onsite
Sr Tech Lead-GenAI - VectorDBand PostgreSQL - HCLTech
AI Engineer
Senior Technical Lead driving end‑to‑end data pipelines, retrieval infrastructure, and LLMOps for AI products, leveraging Python, PostgreSQL and vector databases to deliver robust RAG, conversational assistants and predictive models.
About the role
Key Responsibilities
- Design, build, and maintain scalable data pipelines using Python and Apache Airflow to ingest, transform, and validate large‑scale datasets.
- Implement and operate vector‑based retrieval systems and semantic layers that power RAG, conversational AI assistants, and dashboard copilots.
- Develop production‑grade integrations with PostgreSQL and modern vector databases (e.g., Pinecone, Milvus) to support low‑latency query workloads.
- Lead ML/LLMOps initiatives, providing CI/CD pipelines, containerization (Docker) and orchestration (Kubernetes) for model training, deployment, and monitoring.
- Establish data governance, security, and quality frameworks, ensuring compliance with enterprise standards.
- Collaborate with cross‑functional AI teams to translate reference architectures and data contracts into reliable, production‑ready solutions.
Requirements
- 5–8+ years of hands‑on experience in data engineering, building pipelines and retrieval infrastructure for AI/ML workloads.
- Strong proficiency in Python, SQL, and PostgreSQL, with a deep understanding of relational data modeling.
- Experience with vector databases and similarity search technologies for Retrieval‑Augmented Generation (RAG) use cases.
- Solid background in containerization (Docker) and orchestration (Kubernetes) for scalable ML/LLMOps deployments.
- Proven ability to implement data governance, security controls, and quality assurance processes in production environments.
Skills
pythonpostgresqldockerkubernetes