Job opportunity
QE Lead with AI Experience
Pacer Group
Work Arrangement: Hybrid (2-3 days a week)
Employment Type: Contract / Full Time
Salary/Pay Rate: Open to right candidate.
Domain: BFSI
SKILLS REQUIRED:
This role is open for both full time and well as contract.
10+ years of experience in Quality Engineering, including 2+ years evaluating AI/ML systems.
Strong expertise in Python, test automation, API testing, and integration testing.
Experience designing prompt/response test sets and evaluating accuracy, groundedness, relevance, and hallucinations.
Hands-on experience with regression, bias/safety, performance, penetration, and non-functional testing.
Familiarity with GitHub Actions, GitHub Copilot, Claude Code, Copilot Studio, LangSmith, AppInsights, Log Analytics, and Dynatrace.
Ability to provide auditable test evidence, defect analytics, and go/no-go recommendations for production readiness.
EEOC Compliance:
We are an equal opportunity employer, and all qualified applicants will receive consideration for employment.
DISCLAIMER
AI Usage Policy: Pacer Group uses AI to assist in screening applications. Final hiring decisions are made by human recruiters based on qualifications and experience.
#J-18808-Ljbffr
Apply on source site Employment Type: Contract / Full Time
Salary/Pay Rate: Open to right candidate.
Domain: BFSI
SKILLS REQUIRED:
This role is open for both full time and well as contract.
10+ years of experience in Quality Engineering, including 2+ years evaluating AI/ML systems.
Strong expertise in Python, test automation, API testing, and integration testing.
Experience designing prompt/response test sets and evaluating accuracy, groundedness, relevance, and hallucinations.
Hands-on experience with regression, bias/safety, performance, penetration, and non-functional testing.
Familiarity with GitHub Actions, GitHub Copilot, Claude Code, Copilot Studio, LangSmith, AppInsights, Log Analytics, and Dynatrace.
Ability to provide auditable test evidence, defect analytics, and go/no-go recommendations for production readiness.
EEOC Compliance:
We are an equal opportunity employer, and all qualified applicants will receive consideration for employment.
DISCLAIMER
AI Usage Policy: Pacer Group uses AI to assist in screening applications. Final hiring decisions are made by human recruiters based on qualifications and experience.
#J-18808-Ljbffr