ZE

zenteiqai

Performance Engineer - Inference

Bengaluru · Mid Level

Expect moderate competitionVerified listingPosted 21d ago

Applicants who checked fit first are 3.1× more likely to hear back

Your match scoreFree · sign in

Your score for this role already exists

ASAI compared this JD against 41 signals - skills, seniority, domain, stack overlap etc. Add a resume and it unlocks in about 30 seconds.

Always free · no credit card · 1 tap with Google

What we know about this role

Hiring pulse

LOW

Our tracked job listings for zenteiqai show limited recent activity.

Apply window

First 72 hours

Window passed - posted 21d ago

Early applicants get seen before the pile builds.

Not a repost

The first time we've seen this listing - it hasn't been closed and reopened.

Skills required

7 listed

Memory SystemsThroughputvLLMTensorRTLarge Language Models (LLMs)Graphics Processing Unit (GPU)Python (Programming Language)

You almost certainly match several of these already. Unlock your skill map to see the matches, the gaps, and what to fix first.

Job description

About the Role

We are looking for a Performance Engineer, Inference to understand and improve the systems that

serve our foundation models. Inference is a tightly coupled system spanning model execution, serving

runtimes, distributed systems, accelerators, scheduling, memory, and reliability. You will measure the

system end to end, identify the highest-leverage performance gaps, and work across teams to close

them while preserving correctness.

Responsibilities

• Run cross-layer performance investigations across throughput, latency, memory efficiency,

reliability, and cost.

• Build profiling, benchmarking, and observability tools that make inference performance

measurable and explainable.

• Identify bottlenecks across model servers, batching and scheduling, distributed execution, memory

systems, and accelerators.

• Partner with model, platform, and infrastructure teams to prioritize and land high-impact

optimizations.

• Validate that performance improvements preserve model quality and numerical correctness.

Minimum Qualifications

• Hands-on experience profiling and optimizing ML systems or other performance-critical production

systems.

• Production experience with at least one modern inference stack such as vLLM, SGLang,

TensorRT-LLM, NVIDIA Dynamo, or an equivalent serving runtime.

• Experience serving or operating large models across accelerator-backed infrastructure, including

multi-GPU or multi-accelerator systems.

• Strong Python skills and the ability to read, instrument, and modify large production codebases.

• Solid understanding of transformer inference, distributed systems, latency/throughput trade-offs,

and accelerator performance fundamentals.

Preferred Qualifications

• Experience with large-scale or multi-node inference, including tensor, pipeline, data, or expert

parallelism.

• Experience with GPUs, TPUs, NPUs, or other ML accelerators and associated profiling tools.

• Experience with quantization, low-precision inference, KV-cache optimization, speculative

decoding, or long-context serving.

• Experience contributing to or modifying inference runtimes, kernels, compilers, or distributed

serving components.

• Experience optimizing inference for constrained or on-device environments.

Tools to land this role

Premium

Your match score, skill map and tracker stay free.

Ground Reality

Premium

Spot the dealbreakers in this 278-word post before you apply

Skip jobs with hidden dealbreakers. See what they actually need, what's easy to miss, and how they describe the team.

Ground Reality on every job, plus Insider Path, practice interviews and resume tailoring.

Insider Path

Premium

Find someone who can refer you here

We help you find people there who worked or studied where you did, and draft your first message and follow-up.

Free · no signup

Get tomorrow's jobs before you have to search

Daily job drops, skill trends and free resources - posted straight to the group. Leave any time.

Join WhatsApp Join Telegram

No spam. Just jobs and resources.

Why people use ASAI

Someone shared one job with you. ASAI keeps finding the rest.

Scored, not searched. Every role ranked against your actual profile.
Alerts as often as hourly. Reach new roles while the pile is still small.
Skill gaps, spelled out. See exactly which requirements you don't meet yet.
Verified jobs, only. Say no to ghost jobs. Your time deserves respect.

More AI Engineer roles in Bengaluru

Sr Staff, Physical Design Architect (Flow & ML Automation)

SIsifive · Bengaluru

Software Engineer II

AEAmerican Express · Bengaluru

Lead Data Engineer (GenAI / LLM Applications)

CLclarioclinical · Bengaluru

Specialist System Engineering (4G/5G Packet Core End-To-End Performance Test Coordinator )

ATAtt · Bengaluru

Keep browsing

All AI Engineer jobs in Bengaluru

Two ways in

Applicants who checked fit first are 3.1× more likely to hear back

Your match scoreFree · sign in

Your score for this role already exists

ASAI compared this JD against 41 signals - skills, seniority, domain, stack overlap etc. Add a resume and it unlocks in about 30 seconds.

Always free · no credit card · 1 tap with Google

Free · no signup

Get tomorrow's jobs before you have to search

Daily job drops, skill trends and free resources - posted straight to the group. Leave any time.

Join WhatsApp Join Telegram

No spam. Just jobs and resources.

Why people use ASAI

Someone shared one job with you. ASAI keeps finding the rest.

Scored, not searched. Every role ranked against your actual profile.
Alerts as often as hourly. Reach new roles while the pile is still small.
Skill gaps, spelled out. See exactly which requirements you don't meet yet.
Verified jobs, only. Say no to ghost jobs. Your time deserves respect.