Sr. Software Engineer - AI Platform
Bengaluru · Staff/Principal
Applicants who checked fit first are 3.1× more likely to hear back
Your score for this role already exists
ASAI compared this JD against 41 signals - skills, seniority, domain, stack overlap etc. Add a resume and it unlocks in about 30 seconds.
Always free · no credit card · 1 tap with Google
What we know about this role
HIGH
Our tracked job listings for Penguin Solutions show strong recent activity.
First 72 hours
Window passed - posted 9d agoEarly applicants get seen before the pile builds.
Not a repost
The first time we've seen this listing - it hasn't been closed and reopened.
Skills required
18 listedYou almost certainly match several of these already. Unlock your skill map to see the matches, the gaps, and what to fix first.
Job description
At Penguin Solutions (Nasdaq: PENG) – The AI Factory Platform Company – we’re building a team of innovators who thrive on collaboration, creativity, and the opportunity to help shape the future of AI. As part of the AI technology revolution, our teams design, build, deploy, and manage AI factories for enterprises, sovereign AI initiatives, and neocloud providers worldwide.
Headquartered in Silicon Valley, California, Penguin Solutions operates globally through a network of R&D, manufacturing, and sales locations. For nearly three decades, we have operated at the intersection of memory and AI/HPC infrastructure. That engineering expertise positions us to power the next generation of AI workloads, from training to inference and agentic AI at scale.
Penguin Solutions brings together differentiated infrastructure software, advanced memory, compute systems, end-to-end services, and industry-leading partner solutions in a full-stack AI factory platform designed to help customers deploy and scale AI workloads with speed and precision.
At Penguin Solutions, we value ideas over hierarchy and believe in servant leadership, where leaders enable teams to do their best work. We empower employees to take ownership, drive innovation, and grow through challenging work, continuous learning, and exposure to advanced AI tools and technologies. With flexibility where it matters and a strong focus on outcomes, Penguin Solutions is a place to do your best work, grow your career, and make a meaningful impact.
Job Overview
We are seeking a Senior AI Platform Engineer to build and operate the production AI platform that powers ClusterWareAI. In this role, you will develop the infrastructure, services, and tooling that enable our AI Operational Agent to reliably deploy, retrieve knowledge, execute workflows, and operate at scale in enterprise environments.
You will work closely with AI engineers, platform engineers, and software developers to build secure, scalable, observable, and highly available AI services for production deployments.
Responsibilities
- Build and operate the production AI platform that supports model serving, inference, and AI services.
- Develop scalable retrieval, knowledge management, and data ingestion pipelines to support AI-driven operations.
- Build APIs, platform services, and automation that integrate AI capabilities into ClusterWareAI.
- Implement AI observability, monitoring, evaluation, and operational tooling for production AI services.
- Optimize inference performance, scalability, reliability, and operational efficiency.
- Build and maintain CI/CD pipelines and deployment automation for AI applications.
- Partner with AI, platform, and software engineering teams to deploy AI capabilities into production.
- Contribute to platform security, reliability, and operational excellence.
Qualifications
- Bachelor's degree in Computer Science, Engineering, or a related field.
- 7+ years of software engineering, platform engineering, or infrastructure engineering experience.
- Strong programming skills in Python.
- Experience developing and operating production AI or LLM-powered applications.
- Experience with Kubernetes, Docker, and cloud-native architectures.
- Experience with model serving technologies such as vLLM, NVIDIA Triton Inference Server, or similar platforms.
- Experience building REST APIs, microservices, and distributed systems.
- Familiarity with vector databases, retrieval systems, and RAG architectures.
Preferred Qualifications
- Experience implementing monitoring, observability, and operational tooling for AI services.
- Experience with managed AI platforms such as Azure AI Foundry, AWS Bedrock, or Google Vertex AI.
- Experience with AI engineering tools such as LangSmith, MLflow, OpenTelemetry, or similar technologies.
- Experience deploying GPU-based AI workloads in Kubernetes environments.
- Experience integrating AI services with enterprise applications, APIs, or infrastructure platforms.
- Background in enterprise infrastructure, cloud platforms, or systems management software.
Location
Hybrid - Bangalore
Travel
As needed
Tools to land this role
PremiumYour match score, skill map and tracker stay free.
Ground Reality
PremiumSpot the dealbreakers in this 553-word post before you apply
Skip jobs with hidden dealbreakers. See what they actually need, what's easy to miss, and how they describe the team.
Ground Reality on every job, plus Insider Path, practice interviews and resume tailoring.
Insider Path
PremiumFind someone who can refer you here
We help you find people there who worked or studied where you did, and draft your first message and follow-up.
Free · no signup
Get tomorrow's jobs before you have to search
Daily job drops, skill trends and free resources - posted straight to the group. Leave any time.
No spam. Just jobs and resources.
Why people use ASAI
Someone shared one job with you. ASAI keeps finding the rest.
Scored, not searched. Every role ranked against your actual profile.
Alerts as often as hourly. Reach new roles while the pile is still small.
Skill gaps, spelled out. See exactly which requirements you don't meet yet.
Verified jobs, only. Say no to ghost jobs. Your time deserves respect.
More Machine Learning Engineer roles in Bengaluru
See all
Keep browsing