BengaluruOn-siteStaff/Principal
Applicants who checked fit first are 3.1× more likely to hear back
On-site in Bengaluru.
OK with that?6–10 years asked. AI Engineer roles in Bengaluru usually ask 5-9; a third ask 6+.
You have them?No pay range in the post.
Not a repost. 618 of HCLTech's last 7236 posts were reposts; 1207 of its 6270 open roles are here.
201 AI Engineer roles posted in Bengaluru this week, 1,536 open. See them →
Skills listed in the post · tap the ones you have · 0 of 8
You almost certainly match several of these already.
This post sets 2 stated bars and lists 8 skills. Tap where you stand - nothing is saved, no account needed.
ASAI checks this on every job for you, automatically, so you apply where you fit.
How an ASAI match score looks. Yours is built from your resume, not a guess.
Your score for this role already exists - sign in to view it
ASAI compared this JD against 41 signals - skills, seniority, domain, stack overlap etc. Add a resume and it unlocks in about 30 seconds.
Always free · no credit card · 1 tap with Google
Starts free · 60-Day Pass ₹149 for 60 days, GST included
Free account, no card needed.
LLMOps Engineer
Role Summary
The LLMOps Engineer is responsible for operationalizing, scaling, monitoring, and governing Large Language Model (LLM)–based systems in production. This role focuses on ensuring LLM applications are reliable, performant, cost-efficient, observable, and secure across their lifecycle—from deployment to continuous optimization.
Key Responsibilities
• Deploy and manage LLM-based applications across cloud and hybrid environments.
• Build and maintain production-grade inference pipelines for LLM workloads.
• Design and implement LLMOps pipelines for model, prompt, and configuration lifecycle management.
• Implement monitoring for latency, throughput, cost, errors, drift, and hallucinations.
• Build dashboards and alerts to ensure SLA and reliability targets.
• Optimize inference cost and performance using caching, batching, routing, and autoscaling strategies.
• Enforce security, access control, audit logging, and governance controls for LLM usage.
• Collaborate with Responsible AI teams to operationalize safety and compliance guardrails.
• Enable AI Engineers and Fullstack teams through reusable LLMOps frameworks and platforms.
Required Skills & Experience
• Strong understanding of LLMs, Generative AI architectures, and inference workflows.
• Hands-on experience running LLM-based systems in production environments.
• Strong experience with cloud platforms (Azure, AWS, or GCP).
• Hands-on experience with Docker, Kubernetes, and container orchestration.
• Experience with CI/CD for ML or AI applications.
• Programming and automation skills in Python or similar languages.
• Familiarity with MLOps / LLMOps tooling, monitoring, and logging systems.
Experience Level
• 6–10 years of overall experience in DevOps, Platform, or ML/AI Engineering roles.
• 2–4+ years of experience operating ML or GenAI systems in production.
Success Measures
• Stable, scalable, and cost-efficient LLM systems running in production.
• Reduced production incidents and faster recovery for AI services.
• Faster and safer enterprise adoption of GenAI solutions enabled through robust LLMOps practices.
Good Communication Skills
Get tomorrow's jobs before you have to search