COE Lead

Job Summary

Define and maintain production readiness standards across platform, data, model, application, and securitylayers.
Establish SLO/SLI frameworks for latency, availability, quality, safety, and drift implement error budgetpolicies.
Publish reference architectures for LLM apps, RAG, vector stores, agent frameworks, and batch/streaminference.
Curate deployment blueprints (canary/shadow, blue–green, A/B) for models and prompts with rollbackguidance.
Standardize observability patterns for prompts, embeddings, latency, cost, quality, and safety telemetry.
Own capacity engineering (token/concurrency budgets, GPU/CPU sizing, vector scaling, cache hierarchies).
Define resilience patterns (timeouts, circuit breakers, fallbacks, idempotent retries, semantic/prompt caching).
Set AI security baselines (secrets, private networking, egress controls) and mandate red‑team & safetyevaluations.
Maintain compliance mappings (e.g., ISO 27001, SOC 2, GDPR/DPDP, HIPAA where applicable).
Provide CI/CD pipelines, SDKs, Helm/Terraform templates, and policy‑as‑code for consistent delivery.
Author PRR checklists, runbooks/playbooks, and DR/BCP blueprints (RTO/RPO, multi‑region/site failover).Drive enablement (trainings, brown-bags) and maintain knowledge repositories and decision records.
Partner with solution teams to validate architecture and non‑functional requirements (scale, latency, cost,safety).
Conduct Production Readiness Reviews (PRRs) and certify releases across performance, security, privacy,and compliance.
Implement observability (tracing, metrics, logs),
Key

Key Responsibilities

1. Provide architectural leadership in infrastructure management by designing and implementing scalable solutionsusing cloud platforms (AWS, Azure, GCP) and automation tools (Terraform, Ansible).
2. Define and govern infrastructure strategies by leveraging virtualization technologies (VMware, Hyper-V) tooptimize resource utilization and operational efficiency.
3. Lead technical assessments and solutioning for infrastructure modernization, utilizing monitoring andmanagement platforms (Nagios, SolarWinds) to ensure reliability and performance.
4. Drive cross-domain technical alignment by integrating security frameworks and compliance standards (ISO27001, SOC 2) into infrastructure consulting deliverables.
5. Mentor consulting teams in adopting enterprise-scale design patterns and best practices for hybrid and multi-cloud environments.
6. Collaborate with stakeholders to translate business requirements into technical roadmaps, utilizing advancedinfrastructure analytics and automation.

Skill Requirements

Other Requirements