{"@context":"https://schema.org/","@type":"JobPosting","title":"AI Quality Engineer (Contract)","description":"

AI Quality Engineer (Contract)

\n
Side · Hyderabad, India · Contract · Posted 2026-08-28
\n

Workplace: on_site

Department: Quality Assurance

Description

**AI Quality Engineer

**Location:- Hyderabad
\nWork Mode:- WFO (5 days a week)
\nRole Type:- Contractual (3 months and extension would depend on project requirement and performance)

Key Responsibilities

Test and validate AI-generated insights, recommendations, and decision-making workflows.
Evaluate LLM and RAG systems for accuracy, relevance, consistency, factuality, and hallucinations.
Validate retrieval quality, context relevance, grounding, and response quality in RAG systems.
Test AI agents and autonomous workflows across functional, negative, and edge-case scenarios.
Define AI evaluation criteria, test datasets, quality metrics, and validation processes.
Perform regression testing for models, prompts, RAG configurations, and AI workflows.
Collaborate with AI/ML engineers to identify issues and improve AI system quality.

Requirements

Required Skills

Strong understanding of AI/ML and Generative AI testing.
Hands-on experience testing LLM and RAG-based applications.
Knowledge of LLM evaluation, hallucination detection, relevance, and response quality.
Understanding of AI agents and recommendation systems.
Strong analytical and problem-solving skills.

Good to Have

Experience with PyTest and automated testing frameworks.
Experience building automated AI evaluation and regression frameworks.
Familiarity with tools such as RAGAS, DeepEval, LangSmith, or equivalent.
Experience with CI/CD-based test automation, performance testing, or AI guardrails.
Familiarity with cloud platforms (AWS/Azure/GCP) and observability tools.

Success Metrics

High accuracy, relevance, and reliability of AI outputs.
Strong evaluation coverage across critical AI workflows.
Early detection and reduction of hallucinations and AI regressions.
Reduced production AI quality issues.
Increased confidence and trust in AI-generated insights and recommendations.

Apply

Apply at Side

","identifier":{"@type":"PropertyValue","name":"Side","value":"6062667-workable"},"datePosted":"2026-08-28T00:00:00+00:00","validThrough":"2026-10-27T00:00:00.000Z","hiringOrganization":{"@type":"Organization","name":"Side","logo":"https://asai-public-assets.s3.amazonaws.com/assets/logos/workable/sideinc_logo_thumb.webp?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=ASIAQE5ENA73TG7HAFBL%2F20260828%2Fap-south-1%2Fs3%2Faws4_request&X-Amz-Date=20260828T130929Z&X-Amz-Expires=3600&X-Amz-SignedHeaders=host&X-Amz-Security-Token=IQoJb3JpZ2luX2VjEIH%2F%2F%2F%2F%2F%2F%2F%2F%2F%2FwEaCmFwLXNvdXRoLTEiRjBEAiAQRVsKfzW6SmAVAn5BGPcKCx4EpHROkbXFYgIMUMktvwIgXJj4v4221MnPObs2Q8WoLDdolv2jvHOb1r9l0x8Qum0qvwUIShAAGgwwMTA1NDUzMzQyNjMiDIo2GpRl08cKC8ac9CqcBbBU6Z7b2bDLqlpWuOAHqUvIiPN9U4nxMC%2BMdoAOFxX5shkdVJ3h%2FhfXV30qvl38njyI9W3%2Fq3KZDEPQ%2FCjB3gXIg6R%2Bq%2FHnHr5YrlO3pqjumbXNtrWx9QPeQK5jQ1iC8tTUxr0CJCTo1aUtsUl9%2FsFGCjlV%2FaSo0XAgJ%2FWv5zOeeN%2FcpbCdlkqIKcy8E5rlep05TLNIrjEYnad2Yczpr77f5QQuOceu7Mu6fyx2l7ADE6B2baP3fsjq%2FFGigerloouWD9VnVXFXtwlnAcJcyf27YZXkcoBHQb3It8jxSz0QQ2IC9wWA60MvMFIs4dFRvWy7zPdWvJVkY8uixikc1qf1169YbzXAWn3pBaI5f%2FPrCbk20aq2vRL%2FRwR4IKoeJeNaxgAbbSMBUgdl1CPHfclRV3vRO9gZHAu%2BUIQtlsL%2FXKTPmxM55BZh1EDkDDfZ2OtId9xtD0mOxzdoqWIavoF4BgL3zWmvugsgWOausW9YkkL6fUUNIX2%2Fu9%2FAoy1iCJpY0ey6URTEKig46P6jfaEB%2BRRTBs%2BNVuSMe5M7h1%2BfVBXoT8zMJiL3ynnjlrtQOAzYYniAKoxG29ZKVX8eCvy%2BEP7lYSwwhVa5%2B1230YXfWRuzYUR8e2erZzIiKQ%2FCAfVtyeoH1%2FKuluqfg4RUVrbToRH3CurIvXEp9REYPjIWnTNP8%2B7Rq30f1kJKJD3ijjKCU8vLCgYTbIteXGk2cnD3aY0KGhV5g0esL%2FBAm5r4Bai2VJbHMbxubhWj4TrN85CWlKQ2YVgRXp6M2pT3bt2CzIi7bZY0TX%2FKDXomLvyiMlveyAoEy8%2Fgj71hXIJps6B%2BkRbBiiAGEbcoG3Y%2B%2FIA4b288MmX9y1pUu3dRB%2ByGhtspOtgjHy4FG1DAMMmjxdQGOrIBOfSh6QQ3tqnUlzDkv5Le%2F6oGyKugVTgRBewsvU2I%2FqY9DIXcTlOH6xQ4iCSTfb9kzLG%2BeqN%2BWEihmybEIj%2B557mCN1XowAax7wLohlWPsCmCFNXX0T%2FCTty2fgpehm7ilumSYbGO0Ut5VgHxzmse3SLl9S08PtNmk1khus1I98410Os3H5SkPPni1dYM34ICLcji33jBfGuKzE6QDCJzpgP1abo2l2KnWjLZUCEBSk55Iw%3D%3D&X-Amz-Signature=fa1d06cb081c017c556cf02fe2a212ad1a7951aab3baa7675ecd2090863eb8cc"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Hyderabad","addressCountry":"IN"}},"employmentType":"FULL_TIME","directApply":false}