AI / LLM Engineer
Infosys · infosys.com
PuneLead / Manager10+ yrs
Posted 10 days ago. 93 more Machine Learning / AI Engineer jobs in Pune went up on company career pages this week.
See the newer ones
Straight from the company’s own careers site.
The job in short
Building LLM systems.
PythonSQLAzureDevOpsMicroservicesMachine learningLLMNLPHugging FaceLangChainLlamaIndexRAG
Details
- Found
- 8 d ago · posted 2026-10-28
- Location
- Pune
Full description
About the role
As an AI / LLM Engineer, you will build the AI-enabled capabilities that support summaries, narratives, explanations, recommendations, retrieval, evaluation and governed human review experiences across an enterprise platform.
You will work closely with architects, product teams, data engineers, backend engineers, security, QA and domain specialists to convert AI patterns into production-ready software components.
Responsibilities
Design and implement LLM-powered workflows for summarization, narrative generation, classification, extraction, contextual reasoning, explanation and reviewer-assist use cases.
• Build retrieval-augmented generation pipelines including document ingestion, chunking, embedding generation, metadata tagging, vector indexing, retrieval tuning and grounded response generation.
• Develop reusable prompt templates, prompt versions, context builders, response schemas, evaluation routines and AI orchestration services.
• Integrate with enterprise AI services such as Azure OpenAI, Azure AI Foundry, OpenAI APIs, Google Gemini, Anthropic, Hugging Face or equivalent approved platforms.
• Implement AI run logging, prompt/model metadata capture, evidence citations, output traceability, reviewer feedback capture and human-in-the-loop controls.
•Build AI evaluation routines for answer quality, retrieval quality, hallucination checks, regression testing, consistency and groundedness.
•Collaborate with backend and DevOps teams to containerize AI services, deploy them securely, monitor usage, track costs and troubleshoot production issues.
•Support responsible AI practices such as prompt injection checks, data leakage prevention, policy-based guardrails and AI output validation.
Technical requirements
Minimum 10+ years of experience in software engineering, AI/ML engineering, applied ML, data science engineering or related roles.
•Strong hands-on Python programming experience and practical exposure to LLM-based application development.
•Experience with RAG, vector databases, embeddings, prompt engineering, evaluation frameworks and AI service integration.
•Experience with frameworks such as LangChain, LangGraph, LlamaIndex, Semantic Kernel, AutoGen, CrewAI or equivalent tools.
•Working knowledge of REST APIs, microservices, SQL, structured data concepts, Git workflows, testing and software engineering practices.
•Understanding of document extraction, semantic search, NLP, retrieval quality, hallucination risk, prompt safety and AI evaluation methods.
•Ability to build production-oriented AI components rather than isolated proof-of-concept demos.
Preferred skills
Technology->AI-Agentic AI->Agent Engineering,Technology->AI-AI Engineering->AI/ML Solution Architecture and Design->traditional ai ml,Technology->AI-Data science->AI-Data science,Technology->AI-Machine Learning->ML Platform,Technology->AI-Machine Learning->Responsible AI
Education
Master Of Engineering,Bachelor of Engineering
Machine Learning / AI Engineer jobs in Pune · Machine Learning / AI Engineer jobs in India · All Infosys jobs · Senior Machine Learning / AI Engineer jobs in Pune · Senior Machine Learning / AI Engineer jobs in India · Senior and manager-level jobs in Pune