Pune · Director
Applicants who checked fit first are 3.1× more likely to hear back
Your score for this role already exists
ASAI compared this JD against 41 signals - skills, seniority, domain, stack overlap etc. Add a resume and it unlocks in about 30 seconds.
Always free · no credit card · 1 tap with Google
HIGH
Our tracked job listings for NCSi show strong recent activity.
First 72 hours
Window passed - posted 83d agoEarly applicants get seen before the pile builds.
Not a repost
The first time we've seen this listing - it hasn't been closed and reopened.
You almost certainly match several of these already. Unlock your skill map to see the matches, the gaps, and what to fix first.
About the Role
We are seeking a proactive AI Engineer with strong Infrastructure background to join our team in Pune. We need someone who looks beyond daily operations to understand how AI infrastructure drives real business value. You will design, scale, and optimize high-performance AI platforms while partnering closely with Infra Ops to turn operational challenges into automated, business-aligned AI solutions.
Key Responsibilities
1. AI & Infra Synergy
Design, build, and maintain scalable infrastructure, pipelines, and environments for training and deploying AI/ML models.
Work hand-in-hand with the Infrastructure Operations team to identify operational bottlenecks and solve them using intelligent automation and AI-driven workflows.
Optimize resource utilization (GPU/CPU workloads, storage, compute clusters) to balance high performance with cost-efficiency.
2. Business & Value-Driven Engineering
Translate business goals and operational metrics into concrete AI infrastructure initiatives.
Measure and report on the ROI of infra improvements (e.g., uptime, latency reduction, cloud spend optimization, developer productivity).
Drive a product mindset within the operations unit—focusing on long-term value, system resilience, and scalability rather than quick operational patches.
3. MLOps & Platform Reliability
Establish robust MLOps / LLMOps practices (CI/CD for ML, automated monitoring, drift detection, and model governance).
Implement continuous observability and telemetry for both model performance and underlying infrastructure.
What We’re Looking For
Core Qualifications
Experience: 12+ years of total experience in Software/Infrastructure Engineering, with at least 2–4 years dedicated to AI/ML infrastructure or MLOps.
Infra Background: Proven track record in cloud architecture (AWS, Azure, or GCP), Kubernetes orchestration, containerization (Docker), and Infrastructure as Code (Terraform, Ansible).
AI/ML Tooling: Experience with framework deployments (PyTorch, TensorFlow), vector databases, and MLOps tools (Kubeflow, MLflow, Ray, Triton Inference Server).
Programming: Proficiency in Python, Go, or C++, alongside strong shell scripting and Linux internal skills.
Mindset & Soft Skills
Business Acumen: Ability to connect technical architecture decisions directly to business outcomes, SLAs, and cost management.
Problem Solver: Proactive in identifying systemic operational pain points and designing durable AI/automation solutions.
Collaboration: Strong communication skills with a track record of partnering effectively with cross-functional teams (DevOps, Data Science, and Business Stakeholders).
Mandatory skills:
Preferred Qualifications
Hands-on experience with LLM infrastructure, fine-tuning setups, or retrieval-augmented generation (RAG) pipelines at scale.
Prior experience working in Pune’s tech ecosystem with global distributed teams.
Certifications in AWS/Azure/GCP Architecture or Kubernetes (CKA/CKAD).
INFRA-MS
1
Python,Cloud,IAM,Artificial Intelligence,Large Language Model,Terraform
7 to 10 years
Automation Lead
Python,Cloud,IAM,Artificial Intelligence,Large Language Model,Terraform
Your match score, skill map and tracker stay free.
Skip jobs with hidden dealbreakers. See what they actually need, what's easy to miss, and how they describe the team.
Ground Reality on every job, plus Insider Path, practice interviews and resume tailoring.
We help you find people there who worked or studied where you did, and draft your first message and follow-up.
Free · no signup
Daily job drops, skill trends and free resources - posted straight to the group. Leave any time.
No spam. Just jobs and resources.
Why people use ASAI
Scored, not searched. Every role ranked against your actual profile.
Alerts as often as hourly. Reach new roles while the pile is still small.
Skill gaps, spelled out. See exactly which requirements you don't meet yet.
Verified jobs, only. Say no to ghost jobs. Your time deserves respect.
More AI Engineer roles in Pune
See allKeep browsing